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Preface 


Because this book assumes no specific prior knowledge about psy- 
chology or behavior modification on the part of the reader, it should 
be useful to many individuals who want to know how to effectively 
apply behavior modification to their everyday concerns — ranging from 
helping their children learn life’s necessary skills to solving some of 
their own personal behavior problems. Mainly, however, this book is 
addressed to the following two general audiences: 1. college and uni- 
versity students taking courses in behavior modification, behavior 
analysis, the psychology of learning, and related areas 2. students and 
practitioners of various helping professions (such as education, coun- 
seling, clinical psychology, medicine, psychiatry, nursing, psychiatric 
nursing, social work, speech therapy, physiotherapy, and occupational 
therapy) that are directly concerned with enhancing various forms of 
behavioral development. 

Our separate personal experiences over the past ten years in teach- 
ing members of both of these broad groups convinces us that there is 
an extreme amount of overlap in the information that they desire and 
require about behavior modification. Both groups seem to assimilate 
the principles of behavior and learn and generalize applications most 
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effectively when those applications are explained with reference to the 
underlying behavior principles on which they are based. Therefore, as 
its title implies, this book deals equally with both the principles and 
the tactics (that is, the rules and guidelines for specific applications) 
of behavior modification. 

Our goals, and the manner in which we have attempted to achieve 
them, can be summarized as follows: 

1. To teach the elementary principles and procedures of behavior 

modification. Thus, we begin with the basic principles and procedures, 
illustrate them with numerous examples and applications, and increase 
the complexity of the material gradually. Study Questions provided at 
the end of each chapter promote the reader’s mastery of the material 
as well as his or her ability to generalize to situations not described in 
the text. These questions can also be used for examination purposes 
in formal courses. 
2. To teach practical, “how-to” skills, such as observing and re- 
cording; recognizing instances of reinforcement, extinction, and pun- 
ishment and their likely long-term effects; interpreting behavioral 
episodes in terms of behavioral principles and procedures; and design- 
ing, implementing, and evaluating behavioral programs. To help 
accomplish this, we have appended two types of exercises to most 
chapters: (a) Study Exercises, which encourage the reader to analyze, 
interpret, and develop Programs for the behavior of others, and (b) Self- 
Modification Exercises, which encourage the reader to analyze, interpret, 
and develop programs for his or her own behavior. 

3. To provide advanced discussion and references so that readers 
will learn not only how to apply behavior modification, but also some 
of the basic empirical Support and theoretical underpinnings of the 
field. To separate this material from the more elementary and applied 
material, we have Presented it in the Extended Discussion and Notes 
(ED&N) sections at the end of the chapters. The ED&N sections also 
contain numerous references to relevant articles and books. Thus, 
although it is available for those with the background, interest, and 
time to benefit from it, it can be conveniently omitted without harm to 
the continuity of the text. Separate study questions on the notes are 
provided for those instructors who wish to include them, and as aides 
for students Wishing to broaden their understanding of behavior 
modification. The ED&N sections also provide information that might 


be used by instructors as springboards for lecture material. 
4. To present the material in such 


easy-to-use handbook for practitioners 


Six parts: 


É vioral orientation of the book, including 
the rationale for that orientation. 


Part II covers the basic principles and procedures of behavior 
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modification. Each of the chapters, except for Chapter 14, begins with 
a case history drawn from experiences of the authors or others in the 
fields of retardation, autism, or early education. Such examples readily 
lend themselves to simplified expositions of the principles. Moreover, 
undergraduate behavior modification projects are concerned with 
populations in these areas. Numerous examples of how each principle 
operates in everyday life and how it can operate to the disadvantage 
of those who are ignorant of it are also given. Chapter 14, which covers 
procedures based on respondent conditioning, may be omitted without 
serious harm to the continuity of the text. Most of the procedures dis- 
cussed in the later parts of the text are based primarily on operant con- 
ditioning. (Chapter 26 repeats and elaborates on some of the material 
in Chapter 14, but can be read independently of that chapter.) 

Part III covers no new principles, but rather discusses more 
sophisticated ways to combine and apply the basic principles and 
procedures discussed in Part II. 

Part IV presents detailed procedures for assessing, recording, 
and graphing behavior. It also contains a chapter explaining how 
behavior modification research is typically carried out. Many in- 
structors prefer to present much of this material quite early in their 
Courses — sometimes even at the very beginning. Therefore, we have 
written these chapters so that they can be read independently of the 
rest of the book; they do not depend on any of the other material. We 
recommend that students be required to read these chapters prior to 
carrying out any major projects for their courses. 

Part V deals with how the basic principles, procedures, and 
assessment and recording techniques are incorporated into effective 
programming strategies. In keeping with the rigorously scientific 
nature of behavior modification, we have placed heavy emphasis on 
the importance of empirically validating program effectiveness. After 
describing general guidelines applicable to nearly all behavior modi- 
fication programs, we describe the details of developing token econ- 
omies in a wide variety of settings. Then, the chapters on self-control 
and self-desensitization expand on the self-modification exercises of 
the previous chapters and discuss recent applications to important 
clinical problems. Finally, the chapter on cognitive behavior modifica- 
tion attempts to show that the same behavioral approach that is so 
effective with public (overt) behavior is also applicable to private 
(covert) behavior. 

Part VI expands the reader's perspective of behavior modification. 
It presents an overview of the history of behavior modification and a 
discussion of the ethical issues in the field. Although some instructors 
might feel that these chapters belong near the beginning of the book, 
we believe that the reader is more prepared to fully appreciate this 
material after obtaining a clear and thorough knowledge of behavior 
modification. We placed ethical issues at the end of the book not 
because we feel that this topic is less important than the others. On the 
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contrary, we stress ethical issues throughout the book, and, thus, the 
last chapter provides a reiteration and elaboration of our views on 
this vital subject. We hope that after reading the concluding chapter, 
the reader will be fully aware that the only justification for behavior 
modification is its usefulness in serving all humanity in general, and 
its recipients in particular. 

The writing of this book was made possible by the help of many 
individuals. We gratefully acknowledge the cooperation and support 
of Dr. Glen H. Lowther and the staff at the Manitoba School and 
Sr. Bertha Baumann and the staff at the St. Amant Centre. Much of the 
material in this volume was generated while the authors were involved 
in these institutions, and without the support of the staff there this 
book would not likely have been written. We take special pleasure in 
thanking Dr. Glen Lowther for his continuing encouragement and 
support during the past nine years. He has been a major factor in 
furthering the applied work of the authors as well as in developing 
behavior modification in the province of Manitoba. Grateful acknowl- 
edgement is due to our many students, for their constructive feedback 
on earlier drafts; to Linda McDonald, who helped gather some of the 
material for the "guidelines" sections; to Jim Rennie, for contributing 
a number of study questions; and especially to Joan Lumsden, Lyle 
Wray and Michael LeBow for their many excellent suggestions for 
improvements. We also wish to thank Leila Krumm and Barb Roscoe, 
who cheerfully gave so much energy and their own time in typing 
various drafts of this text. 

Finally, a special thanks to Nickie, Toby, Todd, Kelly, Scott, and 
Tana (from G.L.M.) and to Jonathan (fro 
of their time with us while this book 

Completion of this book was fa 
the Medical Research Council ( 


m J.J.P.), who gave up so much 
was being written. 

cilitated by research grants from 
Grant No. MA-5821) and the National 
Health Grants Program (Grant No. 606-7-255) of Canada to G. L. 
Martin, and grants from the Medical Research Council (Grant No. 


MA-5647) and the National Research Council (Grant No. A7461) of 
Canada to J. J. Pear. 
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because, at its roots, behavior modification is a very complex field, with 
many ramifications. We realize, however, that some students will 
require or desire a deeper knowledge of behavior modification than 
others will. 

Therefore, in each chapter of this book we have separated the 
more elementary material from the material that demands more thought 
and study. The former material is presented in the main body of the 
text. The latter material is presented at the end of each chapter under 
the heading "Extended Discussion and Notes." Reference numerals 
(like those used for footnotes) are placed above key statements in the 
main text to refer you to the corresponding numbered passages in the 
“Extended Discussion and Notes" sections. How you use the "Ex- 
tended Discussion and Notes" sections is up to you and your in- 
structor. You can ignore them altogether and still obtain a good working 
knowledge of the principles and tactics of behavior modification, be- 
cause the main text does not depend on the material in the “Extended 
Discussion and Notes" sections. However, we believe that many stu- 
dents will find these sections very informative and that many teachers 
will find the sections useful in stimulating class discussion and im- 
parting additional background information. 

Another major way in which we have attempted to help you learn 
the materials is by providing guidelines on the use of all of the be- 
havior modification methods discussed in the text. These guidelines 
should prove useful as summaries of the material as well as in helping 
you to actually apply the methods described in the text. 

Numerous study questions and study exercises (including "self- 
modification" exercises) are also presented in each chapter. The study 
questions are intended to help you check your knowledge of the 
material when preparing for quizzes and exams. The study exercises 
and self-modification exercises are intended to help you develop the 
practical skills you will need in order to carry out behavior modifica- 
tion projects effectively. 

To help make your study productive and enjoyable, we progress 
from the simpler and more intrinsically interesting material to the more 
difficult and complex material. We have also deliberately tried to 
program an increasing complexity in the writing style. We urge you 
in the strongest possible terms: Do not be misled by the seeming simplicity 
of the earlier chapters. Many people unjustifiably conclude that they 
are skilled behavior modifiers after they have learned a few simple 
behavior modification principles. Unfortunately, they too often end 
up by once again proving the old maxim that "a little knowledge is a 
dangerous thing." If we personally had to pick the most important 
chapter in this book, in terms of the knowledge and skills that define 
a competent behavior modifier, it would probably be Chapter 21. We 
therefore suggest that you cautiously reserve judgment about your 
abilities as a behavior modifier until you have thoroughly mastered 
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the material in that chapter and all of the preliminary material on which 
it is based. 


With that word of caution, we wish you much success and enjoy- 
ment as you pursue your studies in this new, exciting, and rapidly 
expanding field of behavior modification. 


G.L.M. 
JJ.P. 
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INTRODUCTION 


If you had to think of one word common to all the people in the situ- 
ations listed below, what would that word be? 


When sitting on the toilet, Tommy, an otherwise normal five-year old, never 
urinates, instead, he does it in his pants. 

Judy, a sixteen-year-old high school student, spends almost every evening 
watching TV or going out with friends instead of completing her home- 
work assignments. 

Larry throws violent temper tantrums whenever his parents refuse his de- 
mands. 

Each morning, when medications are given to Charles, an adult epileptic re- 
tarded patient, he resists and tosses them away. 

When asked, "What's your name?" an autistic child named Peter replies, 
"What's your name?" He never answers any questions appropriately; in- 
stead, he merely repeats them. 

Fred, a “normal” adult, fixes breakfast for his kids every morning before go- 
ing to work. 

When driving, Pamela frequently exceeds the speed limit and sometimes 
runs red lights. 

Richard, a delusional psychotic patient, makes absurd statements to anyone 
who will listen to him. 
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Alice is so afraid of small enclosed spaces that she will walk up ten flights of 
stairs rather than ride the elevator 


Have you thought of a suitable word yet? If one of the words 
you are thinking of is “behavior,” then either you are very clever, or 
you are “psychic,” or you cheated by looking ahead — because "be- 
havior” is correct. Each of the above statements tells us something 
about the way in which a certain person behaves in a certain situ- 
ation. 

But what is behavior? Some commonly used synonyms would 
include "activity," action," “performance,” “responding,” "re- 
sponse,” and "reaction." Although it is difficult to give a precise def- 
inition of behavior, we would bet that you have a good idea of what 
we mean by the term. Is the color of someone's eyes behavior? Is 
blinking behavior? Are the clothes someone is wearing behavior? Is 
dressing behavior? If you said no to the first and third questions and 
yes to the second and forth, then we are in agreement. One of the 
goals of this book is to encourage you to begin thinking and talking 
very specifically about behavior, 

Now consider some examples that are a bit more difficult. Is in- 
telligence a behavior? Is an attitude behavior? Is motivation behav- 
ior? Is creativity behavior? If not, then what are they? 

What do we mean when we say that a person is intelligent? We 
do not mean that he has something inside of him called "an in- 
telligence," for we never Observe any such thing. What we do mean 


is that he tends to engage in certain kinds of behavior under certain 
conditions. Perhaps he read 


difficult, performs well (by someone's Standards 


word, "intelligence" can mean any or all of these— but whatever it 
means, it refers to ways of behaving. 


What about an attitude? Su 
reports that he h 
Smith mean by this? 
School, refuses to 


about Johnny's 
he is really con- 


"bad attitude," 
cerned. 


individual frequent 
that, at the same time, have desirable effects. 


Now what about mental retardation, childhood autism, child- 
hood schizophrenia, learning disabilities, and emotional distur- 
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bances? These also are labels for certain ways of behaving. How do 
specialists decide that someone is severely retarded? They make the 
decision primarily because they might observe that the person, after a 
certain age, 


cannot tie shoelaces; 
is not toilet-trained; 
eats food only with his fingers or a spoon; 


performs on psychological tests in such a way that the combined answers 
yield an IQ score of 35 or less. 


How do specialists decide that someone has a learning disability? 
They make the decision on the basis of certain behaviors that they 
observe, such as 


attending to a task for only a few seconds or minutes (typically labeled a 
"short attention span”); 

staring at an item for many minutes (typically labeled “perseveration”’); 

moving frequently from one position, location, or task to the next (labeled 
“hyperactivity”’); 

confusing spoken words, such as “thumb” for "tongue" (labeled "speech 
disability"); 

inverting words while reading, such as "saw" for "was" (labeled a "reading 
disability" or "'dyslexia"). 


How do specialists decide that a child is autistic? They make this de- 
cision on the basis of certain behaviors that they observe. For ex- 
ample, they might observe that a child 


frequently mimics particular questions rather than answering with an appro- 
priate statement; 

engages in various self-stimulatory behaviors, such as rocking back and 
forth, twirling objects with her fingers, or fluttering her hands in front of 
her eyes; 

when called, does not respond, or moves away from the person doing the 
calling (more generally, he shows antisocial behavior); 


performs much below average on a variety of self-care tasks, such as dress- 
ing, grooming, and feeding. 


In all of these cases, decisions are based on observable behavior, 
not on invisible "mental" abnormalities. The behavior of people who 
are given the above labels is compared with the behavior of others of 
approximately the same age and perhaps with a similar amount of 
training and educational background, and the comparison shows that 
the individual labeled "retarded," “autistic,” or "learning-disabled" 
have "behavior problems" —that is, "behavioral deficiencies" (too 
little behavior of a particular type), "behavioral excesses" (too much 
behavior of a particular type), or "behavioral inappropriatenesses” 
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(doing the wrong thing at the right time or place, or the right thing 
at the wrong time or place). The same is true for individuals who are 
labeled "emotionally disturbed," "childhood schizophrenics," "slow 
learners," "neurotics," “psychotics,” and so forth. The labels are ap- 
plied when the person emits behaviors that are considered "abnor- 
mal." In all such cases, it is behavior that causes concern. Certain be- 
haviors that parents see and hear often cause them to seek 
professional help for their children. Certain behaviors teachers see 
and hear often prompt them to have children removed from their 
classroom. Behaviors that can be seen or heard cause governments to 
set up institutions, clinics, community treatment centers, and special 
programs. 

You may be wondering why we stress so strongly the impor- 
tance of defining all of the above types of problems in terms of be- 
havior. The reason is that there are specific procedures now available 
that can be used in school settings, home settings— in fact, just about 
anywhere there is a need to overcome behavior problems and to es- 
tablish more desirable behaviors. These techniques are referred to 
collectively as behavior modification.* There is now a great deal of 
factual evidence that these techniques work extremely well in all of 
the above areas of concern. The main purpose of this book is to de- 
scribe these techniques in an enjoyable, readable, and practical man- 
ner. We intend in this book to help the reader learn not merely about 
behavior modification but also how fo use it to overcome behavioral 
deficiencies, excesses, and inappropriatenesses. 

The behavior modification approach is different in several re- 
spects from many of the more traditional psychological and medical 
rent in one major respect. Many 
s to mental retardation, learning 
ntioned above have been strongly 
reas) by what the experts call the 
eat strides by looking for the 
Things like viruses, tumors, 
ause a variety of observable 
As a result, it often seems as 


is no accident. As illustrated in 
is based on the su ition that 

. ona pposition 

he observable behavior is a symptom of a “mental” deficiency, dis- 

turbance, or ailment of some sort.! j 
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Introduction 


Perhaps you are thinking, ‘Surely psychologists and educators 
aren’t suggesting that disturbed children have little people inside their 
heads telling them what to do.” Technically, you are right. Never- 
theless, these professionals frequently assume that the disturbed be- 
havior is primarily a symptom of some genetic, biological, or mental 
cause that we cannot readily observe. In that sense, they are more or less 
assuming that a “little person” is the cause of the inappropriate behav- 
ior. Unfortunately, the psychologists and educators have not been as 
successful as the medical people in accurately identifying these hidden 
causes (i.e., the “little people"), and therefore they haven't been able to 
prescribe successful treatments. Consequently, a great deal of time and 
energy has gone into discussions and arguments regarding the sup- 
posed causes of disorders such as mental retardation and learning dis- 
abilities, as portrayed in Figure 1-2.” 

Behavior modifiers are different in that they assume that current 
behaviors are caused largely by environmental experiences. Nothing 


Hi, IM MENTAL E. 

RETARDED. / CAUSE 

YOU TO ACT. DIFFERENT 

THAN OTHER KIDS, AND 

NOW ! WANT YOU TO THAT'S IT, KEEP CRYING. 

ROCK, SO START l'M GOING TO MAKE 

ROCKING. YOU CRY AT EVERY 

— LITTLE THING, ORMY 
NAME ISN'T EMOTIONAL 


E._DISTURBED. I'M YOUR 


DEPRESSED MIND 
AND YOU HAVE TO 
LISTEN TO ME. NOW 
TEAR THE REST QF 
YOUR SHIRT: 


m 


FIGURE 1-1. Traditional explanations of such behavior as excessive rocking 
back and forth, excessive crying, and clothes tearing. 
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is gained by talking of the behavior as a symptom of some inner 
cause. The behavior modifiers agree that there are causes of the ob- 
servable behavior, and that some of those causes may indeed be 
unobservable, complex inner "things" of some sort or another. Re- 
gardless of the cause, however, the behavior is still there and is still 
being influenced by the individual’s immediate environment. The 
mother in Figure 1-2, for example, is still concerned about what to do 
with her retarded child and how to handle the retardation. "So," say 
the behavior modifiers, "let's spend a great deal of time and energy 
trying to teach more appropriate behavior, since we have to do some- 
thing for the individual in spite of the unknown causes of the behav- 
ioral problems." Of course, if and when the causes are identified and 
cures involving something better than behavior modification are 
discovered, then behavior modifiers should be among the first to 
utilize them. Until that time, however, there is a great deal that can 


be done simply by using our existing behavior modification pro- 
cedures. 


THE CHILD OBVIOUSLY 
HAS MIN/MAL BRAIN 
DYSFUNCTION. 


NO, NO, IT HAS TO BE 
ENCEPHALOPATHY! 


THANK YOU, EXPERTS. 
BUT WHAT CAN I DO 
ABOUT IT? 


PA 7 
^) 


FIGURE 1-2. The experts "helping" mother with her child? 
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Introduction 


To summarize, the behavior modification approach focuses pri- 
marily on observable behavior.* Individuals who are labeled men- 
tally retarded, autistic, or whatever, are individuals who show behav- 
ioral deficiencies, excesses, and/or inappropriatenesses. Behavior 
modification consists of a set of procedures that can be used to 
change behavior so that these individuals will be considered less re- 
tarded, less autistic, or less of whatever label has been given them. 

“Wait a minute,” you say. “It sounds like this book is primarily 
for people concerned with helping severely handicapped individuals.” 
In answer to sucha query, we wish to point out that the behavior modi- 
fication procedures described in this volume can be used to solve the 
behavior problems of any individual. Even people who are normal or 
average in most respects have one or two annoying habits that can be 
considered behavioral deficiencies, behavioral excesses, or behavioral 
inappropriatenesses. Such a classification may subsequently help 
an individual to select the most appropriate behavior modification 
procedure, in that some procedures increase behaviors, some decrease 
behaviors, and some help to change the time or place of occurrence of 
behaviors. 


Consider the following behavioral deficiencies: 


1. A normal child does not pronounce words clearly, put toys away after 

playing with them, or eat a reasonable amount of food at mealtimes. 

A normal teenager does not complete homework assignments, help 

around the house or work in the yard, or discuss problems and diffi- 

culties with his parents. 

3. A normal adult does not stop at stop signs and traffic lights while driving, 
express sincere thanks to others who help her in various situations, or 
meet her spouse or arrive home at previously agreed upon times. 


N 


Consider the following behavioral excesses: 


1. A normal child frequently plays in the middle of the street, gets out of 
bed and throws tantrums at bedtime, plays with the dials on the televi- 
sion set, and throws food on the floor at mealtime. 

2. A normal teenager frequently interrupts conversations between his par- 
ents and other adults, spends hours talking on the telephone in the eve- 
ning, and uses abusive language with adults. 

3. A normal adult watches television excessively, frequently eats candies and 
other sweets between meals, and bites her fingernails. 


Consider the following behavioral inappropriatenesses: 


1. A normal child says “da-da” when daddy is around but also when the 
milkman comes to the door, puts toys in the garbage can and cigarette 
butts in the toy box, and uses a crayon to write on walls but does not 
write on paper provided him. 
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2. A normal teenager helps a neighbor shovel gravel on a driveway but will 
not take out the garbage for her mother, and talks incessantly to members 
of the same sex but shows a great deal of embarrassment and difficulty in 
talking to members of the opposite sex. 


3. A normal adult reads the newspaper at breakfast, when his spouse wants 
to talk, rather than at more reasonable times; wakes the spouse up in the 
middle of the night to “have sex,” rather than considering his desires and 


timing from the partner’s point of view; laughs at funny jokes, but also 
laughs on sad occasions. 


The list of behavior problems exhibited by normal individuals 
could go on and on. The point at which a particular behavior is con- 
sidered deficient, excessive, or inappropriate is determined primarily 
by the practices in the culture and by the desires, wishes, and ethical 
views of concerned individuals. Regardless of the reasons that a par- 
ticular behavior is deficient, excessive, or inappropriate, the proce- 
dures described in this book can help to overcome the problem." 

In the following pages, we will describe the principles and 
Procedures of behavior modification with examples of their appli- 
cation. The procedures described do not involve such things as psy- 
chosurgery, electro-convulsive therapy, or the use of drugs. Rather, 
the procedures are ways of rearranging an individual’s environment 
and daily activities in order to help that individual function more 
fully in our society. We will also describe more detailed program 
strategies, as well as ethical considerations in the design of programs. 
We hope that this book will indeed give satisfactory answers to 
teachers, students, teenagers, adults, fathers, mothers, and others 
Who say, "Thank you, Mr. Expert, but what can I do about it?" (the 
question asked by the mother in Figure 1-2). We hope also that the 
book will provide introductory students of behavior modification 
with an understanding of why the procedures are effective. 


Study Questions 


(for examination purposes) 


1. What is behavior? 


at 4. 
Introduction 5 
6. 
7. 
8. 
9. 


What is behavior modification? (See pp. 9 and 10.) 


. What is a major difference between traditional approaches and the behav- 


ior modification approach to such disorders as mental retardation and au- 
tism? 

What is a behavioral deficiency? Give two examples. 

What is a behavioral excess? Give two examples. 

What is a behavioral inappropriateness? Give two examples. 

From a behavioral point of view, what is intelligence? creativity? 


Study Exercises 
(to be practiced by the reader) 


. Consider someone who is personally close to you (e.g., a sister, a brother, 


or a lover). From your point of view, identify 

a. two behavioral deficiencies to increase in that person; 

b. two behavioral excesses to decrease; 

c. two behavioral inappropriatenesses to change. 

You and a friend observe the same child for two minutes. Working inde- 
pendently, each of you list all the behaviors you see. Then compare lists. 
Is your list identical to your friend's? (In other words, are your lists con- 
sistent?) 

Working independently again, you and your friend observe the same 
child for ten minutes. This time, list only occurrences of social behavior. 
Are your lists identical? 

If the lists you made in question 3 differ, can you offer any possible rea- 
sons for the difference? 

In order to improve the reliability of their observations, behavior modi- 
fiers have learned to define very specifically the behavior they are observ- 
ing. Prepare three specific and different definitions of social behavior for 
the child you observed. 

Using one of your specific definitions of social behavior, redo question 3. 
Are your lists consistent now? 


Self-Modification Exercise 
(to be practiced by the reader) 


Assume that you would like to make yourself a better person. The first step 
would be to identify areas in which you would like to change. 


1. 


2. 


List three specific behavioral deficiencies that you would like to over- 
come. 

List three specific behavioral excesses that you would like to decrease or 
eliminate. 

List three specific behavioral inappropriatenesses such that you wish to 
keep the behavior but change the time and place at which it occurs. 
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The model in physical medicine in which germs, Viruses, lesions, ang 
other dict urBantos id to the production of symptoms in the pen: 
ing of a normal human organism represented a major breakthroug 
in physical medicine during the nineteenth century. This view was 
adopted by Freud in his view of man and his attempt to describe 
causes of abnormal behavior. Abnormal behavior was clearly viewed as 
a symptom of an underlying disturbance in a personality mechanism 
The implication of this was that one must treat the underlying person: 
ality disturbance rather than the observed symptom (the abnormal b; 
havior). A behavioral approach, on the other hand, suggests the Panon 
mal behavior is a function of specifiable environmental causes (at leae 
primarily). Whether or not these causes can be identified, it is possible 
to rearrange the environment in such a way that the behavior can be 
changed or improved: Although Freud also emphasized the importance 
of the individual’s environment, that emphasis was placed on very early 
childhood experiences. Behavior modifiers concentrate on changing 
behavior by changing the individual's present environment. For a dis- 
cussion of the application of the medical model to psychotherapy as 
developed by Freud, the reader is referred to Jones (1953). For a more 


detailed discussion of a comparison of the medical model with the be- 
havioral model, the reader is referred 


1-39). It should be pointed out that 
psychiatrists who talk about the "medi 
follow this model developed so succes: 
is also obvious, however, that physi 


is this direct treatment of the problem 
he approach of behavior modifiers. 


For example, many writers in the area of learning disabilities have 
postulated or inferred that the cause of disability is some nebulous neu- 


amage called “minimal brain dysfunction." Text- 
books and articles by prominent professionals in the field simply define 


Served behavioral deficit or disability 
(for example, see Myklebust, 1968; Tarnapol, 1969). There are several 
disadvantages to. this approach. 


8s others have no 
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(Continued) 

havior should be clearly delineated, independently measured, and ex- 
perimentally evaluated. Variables responsible for certain behaviors or 
behavioral deficits should be experimentally demonstrated as causal 
and not defined into existence, especially when the supposed cause of 
behavior (for instance, minimal brain dysfunction) has rarely, if ever. 
been specified. $ 

Third, there are many individuals with measured nervous-system 
damage or brain injuries who do not suffer disabilities in various learn- 
ing areas (for example, see Yacorzynsky and Tucker, 1960). Those who 
appear to interpret a few positive correlations between test results and 
other behaviors as indications of cause-and-effect relations have many 
exceptions to contend with. 

Fourth, there is a great deal of confusion about the particular 
learning disabilities whose causes individuals are searching for (for ex- 
ample, see the discussion by Martin and Powers, 1967, concerning at- 
tention span). It seems, in other words, that many individuals have been 
searching for nebulous causes of poorly specified behaviors. 


Because behavior modifiers have been very concerned with trying to 
scientifically demonstrate the effectiveness of the various modification 
procedures in influencing behavior, they have emphasized the impor- 
tance of observable behavior that can be reliably measured. Perhaps for 
this reason many people have mistakenly assumed that behavior modi- 
fication is not concerned with private or covert behaviors. This mis- 
taken view might also have developed because behavior modifiers ini- 
tially treated primarily observable behaviors; only recently have they 
tackled the problem of modifying inner thoughts, feelings, and so forth 
(this will become clear in later chapters). Whatever the reasons, the as- 
sumption is clearly mistaken, since behavior modifiers currently deal 
with private activities and have recognized their importance since the 
early development of behavior modification (for example, see Skinner, 
1953, Chapters 10, 15, 16, 17, and 18). 


It should be emphasized that behavior modification procedures have 
not been limited to solving individual problems. They have extremely 
wide applicability in a variety of areas. For example, Skinner (1953) de- 
scribed how basic behavioral principles might be used to analyze the 
control exerted in our environment by religion, psychotherapy, education, 
economics, government, and law. A number of interesting applica- 
tions of behavior modification have recently occurred in the community, 
concerning such things as litter control, urban recreation, low-income 
self-help programs, and group living arrangements (Martin and Osborne, 
in preparation). Although we will elaborate on these developments to 
some extent in later chapters, our primary concern is to teach behavioral 
principles, procedures, and programming strategies by illustrating their 
application to individual behavior problems. 


Study Questions on Notes 


1. Briefly, what is the medical model in medicine? In psychology? 

2. How does the behavioral approach to abnormal behavior differ from 
the medical-model approach? 

3. Can you think of some exceptional cases (perhaps from your in- 


(Continued) 
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CHAPTER 2 


Getting A Behavior 


to Occur 
More Often With 


POSITIVE REINFORCEMENT 


“Charles, take your pills” 


CHARLES'S CASE 


Charles was a severely retarded, institutionalized adult.* He had a long his- 
tory of spitting out the pills that the nurses gave him each morning and af- 
ternoon. Since he weighed about 217 pounds and was very strong and ac- 
tive, he was often successful in resisting most of their efforts to force him 
to swallow his pills. Making him take his pills was, in the words of one 
aide, "kind of like force-feeding a Brahman bull." Since Charles was prone 
to having quite severe epileptic seizures if he did not take the pills, it was 
clearly important that he do so. One of the psychiatric nurses, who was 


*We gratefully acknowledge Dr. Lynn Caldwell, Department of Rehabilitation Medi- 
cine, University of Washington, for providing us with the details of Charles's case. 
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taking a course in behavior modification, thought to herself, "This is a 
r positive reinforcement!" ] "e" 
ke pis activity that Charles liked very much was smoking, ees yc 
rettes were not always available to him. One morning, Ms. e: em di 
inspired nurse) sat down with him. On a nearby table, outside o nig we 
reach, she placed a handful of pills. (Actually they were phony E Ed 
looked and tasted much like the real thing.) She proceeded A E 
Charles ten pills in succession, at approximately one-minute T pis 
Structing him each time to swallow the pill. Charles up ian d E 
pill given to him, but each of the other pills was thrown down. “So nd 
for instructions," she said, having thus established that instructions a 
o the trick. i ] 
nr - D ten minutes, again at approximately one-minute va 
vals, Ms. Peabody attempted very firmly to place a pill in Charles's vu 
He spat out the first seven pills, but swallowed the eighth. The nint eng 
tenth pills, however, were also spat out. It seemed that force was als 
"bad deal." - 
Note that up to this point, the only procedures that the nurse 1 
tried were (1) instructing the patient to swallow his pill and (2) attempting 
to force him to take it. Her results demonstrated clearly that both proce 
dures were ineffective with Charles. OION 
Next, Ms. Peabody held up a cigarette and said to Charles, "If y X 
swallow this pill when | put it in your mouth, I'll give you a puff on inis 
cigarette.” Then she placed the pill in his mouth, but once again he spat ! 
out. During the next four minutes, Charles spat out four more pills, all we 
while making motions for Ms. Peabody to give him a cigarette, or at leas 


: d 
a puff. But she remained firm. He swallowed the sixth pill that she i 
in his mouth, and was immediately given a puff on the cigarette along w! 
a great deal of praise. 


gan another session. Ai 


placed in his mouth and was told that he would receive a puff on a ciga- 
rette if he did so. He 


next eight i 


te sessions, and Charles swallowed all of the 
pills but one. " 
The results of this little experiment can be seen quite clearly in Fig- 
ure 2-1. 


Following the training with the fake pills, it was easy for Ms. Peabody t? 
Switch to the real pills at 


medication time. 


POSITIVE REINFORCEMENT 


einforcement has two parts: (1) If in a 
does something that is followed immedi- 


ately by a certain consequence, then (2) that person is more likely to 
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Instructions Force Instructions, Puffs, and Praise 
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Ten-Minute Sessions 


FIGURE 2-1. Charles's pill-swallowing behavior. Each data point (o) repre- 
sents the number of pills swallowed (numbered up the side) in a ten-minute 
session (numbered across the bottom) in which pills were presented at one- 
minute intervals. 


do the same thing again when he next encounters a similar situation. 
Such a consequence is called a positive reinforcer, a term that is 
roughly synonomous with the word reward.' Although everyone has 
a common-sense notion of rewards, very few people are aware of just 
how frequently they are influenced by positive reinforcement during 
every hour of every day of their lives. Some examples of instances of 
positive reinforcement are shown in Table 2-1. (The terms "positive 
reinforcement” and "reinforcement" are often used interchangeably.) 


The individuals in each of the examples in Table 2-1 were not 
consciously using the principle of reinforcement; they were just 
"doing what comes naturally." In each example, it might take several 
repetitions before there would be any really obvious increase in the 
reinforced response (that is, an increase that would be really notice- 
able to a casual observer). Nevertheless, the effect is still there. Every 
time we do something, no matter what it is, there are consequences 
that either “turn us on” or “turn us off" or don't affect us one way or 
the other. Think about what you have done in the past hour, the past 
day, the past week, and think of the immediate consequences of 
some of those activities. Can you identify those consequences? 

It is helpful to think about behavior in the same way that we 
think about other aspects of nature. What happens when you drop 
your shoe? It falls towards the earth. What happens to a lake when 
the temperature drops below zero centigrade? The water freezes. 


TABLE 2-1. Examples of Instances of Reinforcement of Desirable Behaviors 


SITUATION 


1. Mother is busy 
ironing in the 
kitchen. Her 3- 
year-old daughter 
is whining and 
attempting to get 
her attention. 


2. While you are 
waiting in a long 
line of cars for 
the light to 
change at a busy 
intersection, a 
car stops in the 
alley on your 
right. 


3. The students in a 
grade-three class 
have been given 
an assignment to 
complete. 


4. Father and child 
are shopping ina 
department store 
on a hot after- 
noon and both 
are very tired. 


5. A woman has just 
tasted a batch of 
soup she made, 
and it tasted very 
bland. 


6. A husband and 
wife are undress- 
ing and getting 
ready for bed. 


RESPONSE 


The child gives up 
after five minutes 
and begins playing 
with baby sister. 


You wave to the 
driver in the alley to 
pull into the line of 
traffic in front of 
you. 


Suzy, who is often 
quite disruptive, sits 
quietly in her desk 
and works on the 
assignment. 


The child (uncharac- 
teristically) follows 
father around the 
Store quietly without 
complaining. 


She adds a little 
Worcestershire 
sauce, 


The husband Picks 
up her panties and 
bra and places them 


in the laundry ham- 
per. 


IMMEDIATE 
CONSEQUENCES 


Mother has just 
completed her iron- 
ing, and sits down 
to play with daugh- 
ter and baby sister 
for a brief period. 


The driver nods and 
waves thanks to you 
and pulls into the 
line of traffic. 


The teacher walks 
Over to Suzy and 
Says, "You're work- 
ing very hard, Suzy. 
How would you like 
to help me hand out 
the papers during 
the next period?" 
Father turns to the 
Child and says, 
"You've been such a 
good girl. Let's go 
and buy an ice- 
cream cone and sit 
down for a while." 


"It tastes very tangy, 
just like minestrone 


Soup," she Says to 
herself. 


His wife pats him on 
the bum and mur- 
murs her thanks. 


LONG-TERM 
EFFECTS 


In the future, the 
daughter is more 
likely to play with 
baby sister rather 
than annoy mother 
because of the 
attention given when 
she began playing 
with her baby sister. 
The pleasant feed- 
back from the driver 
increases the likeli- 
hood that you will 
engage in similar 
courtesies in similar 
situations in the 
future. 


In the future, Suzy is 
more likely to work 
on the assignments 
given to her in class. 


On future shopping 

excursions, the child 
is more likely to fol- 
low father quietly. 


There is an 
increased liklihood 
that in similar situ- 
ations in the future. 
She will add Worces- 
tershire sauce to her 
Soup. 


In future evenings. 
the husband is more 
likely to put her 
underwear in the 
laundry hamper. 


TABLE 2-1. (Continued) 


IMMEDIATE LONG-TERM 
SITUATION RESPONSE CONSEQUENCES EFFECTS 
7. One of the The author jiggles The tape recorder The likelihood of 
authors of this one of the wires starts working. wire jiggling 
book is attempt- attached to the increases in similar 
ing to dictate microphone. situations in the 
some material future. 


into the tape 
recorder, but the 
tape recorder is 
not working. 


These are things that we all know about and that physicists have 
studied extensively and formulated into laws, such as the law of 
gravity. The principle of positive reinforcement is also rapidly ap- 
proaching the status of a law. Scientific psychology” has been study- 
ing this principle in great detail since the 1930s, and we know that it 
is the single most important part of the learning process. We also 
know of a number of factors that determine the degree of influence 
the principle of reinforcement will have on behavior. These factors 
have been formulated into guidelines to be followed when using pos- 
itive reinforcement to strengthen desirable behavior. 


FACTORS INFLUENCING THE EFFECTIVENESS OF 
POSITIVE REINFORCEMENT 


1. Selecting the behavior to be increased 


The behavior selected should be a specific behavior (such as smiling) 
rather than a general behavior category (such as socializing). For ex- 
ample, Ms. Peabody chose to increase Charles's pill-swallowing be- 
havior rather than concentrating on a vague category of behavior 
such as cooperativeness. By being specific in this way, you (a) help 
ensure the reliability of detecting instances of the behavior and 
changes in its frequency, which is the yardstick by which one judges 
reinforcer effectiveness; and (b) increase the likelihood that the rein- 
forcement program will be applied consistently. 


2. Choosing reinforcers (“different strokes for 
different folks") 


Some stimuli are positive reinforcers for virtually everyone. Food is a 
positive reinforcer for almost every person who has not had anything 
to eat for several hours. Candy is a reinforcer for most children. 


S.C.E R T.. West Rengal 
Dat» Y EO. 7. 78 
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On the other hand, different individuals are frequently “turned 
on" by different things. In Charles's case, for example, cigarettes 
were very effective reinforcers. But they wouldn't have been so for 
someone who didn't smoke. Consider the case of Dianne, a six-year- 
old retarded girl who was in a project conducted by one of the au- 
thors. She was able to mimic a number of words, and we were trying 
to teach her to name pictures. Two reinforcers commonly used in the 
project were candy and bites of the child's supper, but neither of 
these proved very effective with Dianne. She spat them out about as 
often as Charles initially spat out the pills Ms. Peabody gave him. Af- 
ter trying many other potential reinforcers, we finally discovered that 
allowing her to play with a toy purse for fifteen seconds was very re- 
inforcing. As a result, after many hours of training she is now speak- 
ing in phrases and complete sentences. For another child, listening to 
a music box for a few seconds turned out to be an effective reinforcer 
after other potential reinforcers had failed. The above-mentioned 
stimuli might not have been reinforcing for everyone, but that is not 
important. The important thing is to use a reinforcer that is effective 
with the individual with whom you are working. 

Most positive reinforcers can be classified under five somewhat 
overlapping headings: consumable, activity, manipulative, posses- 
sional, and social. Classified as consumable reinforcers are such 
things as candy, cookies, fruit, and soft drinks. Examples of activity 
reinforcers are the opportunities to watch television, look at a picture 
book, or even stare out of a window. Manipulative reinforcers in- 
clude the opportunities to play with a favorite toy, color or paint, 
ride a tricycle, or tinker with a tape recorder. Possessional reinforcers 
refer to the opportunities to sit in one’s favorite chair, wear a favorite 
shirt or dress, have a private room, or enjoy some other item that one 


can possess (at least temporarily). The fifth category is that of social 
reinforcement i i 


smiles, and 


s, praise, nods, 
of social atten- 


tiveness, 


In choosing effective reinforce 
helpful to complete a r 


is shown in Figure 2-2 


i ers for an individual, it is often 
einforcer Survey. An example of such a survey 
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FIGURE 2-2. A questionnaire to help an individual identify reinforcers. 


This questionnaire is designed to help you find some specific individuals 
objects, events, or activities that can be used as reinforcers in an improve- 
ment program. Read each question carefully, and then fill in the appro- 


priate blanks. 
A. Consumable Reinforcers: What does this person like to eat or 
drink? 


y 


2. 


What things does this person like to eat most? 
a) regular meal-type foods 


b) health foods— (dried fruits, nuts, cereals, etc.) 


c) junk foods— popcorn, potato chips, etc. 


d) sweets — candies, ice cream, cookies, etc. 

What things does this person like to drink most? 
a) mik — ey juices 
b) soft drinks ———— d) other 


B. Activity Reinforcers: What things does this person like to do? 


T 


Activities in the home or residence 
a) hobbies 
b) crafts 
c) redecorating 
d) preparing food or drinks 
e) housework 
f) odd jobs 
g) other 
Activities in the yard or courtyard 
a) sports 
b) gardening activities 
c) barbecue 
d) yard work 


e) other 
Free activities in the neighborhood (window shopping, walk- 


ing, jogging, cycling, driving, swinging, teeter-tottering, etc.) 


Free activities further away from home (hiking, snow shoeing, 
swimming, camping, going to the beach, etc.) 


Activities you pay to do (films, plays, sport events, night clubs, 
pubs, etc.) 


Passive activities (watching TV, listening to the radio, records, 
or tapes, sitting, talking, bathing, etc.) 
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C. Manipulative Reinforcers: What kinds of games or toys does this 
Person like to play with? 
Toy cars and trucks 
Dolls 
Wind-up toys 
Balloons 
Whistle 
Jump rope 
Coloring books and crayons 
Painting kit 
Puzzles 
10. Other —— 
D. Possessional Reinforcers: What kinds of things does this person 
like to possess? 
1. Brush 
Nail clippers 
Hair clips 
Comb 
Perfume I — 
Belt : 
Gloves 
Shoelaces - —————— 
. Other 
E. Social Reinforcers: What 
does this person like to re 
8) "Good girl (boy)" 
b) "Good work" n E es 
C) "Good job" - l— 
d) "That's fine" 
€) "Keep up the good work" "o = 
f) other ] i Fa 
2. Physical contact 
8) hugging x ees EN 
b) kissing 
C) tickling ] E 
d) patty-cake 7 = cd 
9) wrestling mu — 
f) bouncing on knee _ 
9) other 


omuooonROMN:IZ- 


f» £o Le» Ot. e qo 


kinds of verbal or physical stimulation 
ceive from others (specify who)? 
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stop. Besides, it was too noisy. However, as you can see in Figure 
2-2, there are many potential activity reinforcers.* 

It is often quite effective to allow an individual to choose among 
a number of available reinforcers. Variety is not only the spice of life, 
it is also a valuable asset to a training program. For example, a tray 
containing sliced fruits, peanuts, candy, and coke can be presented to 
a severly retarded child after each desired response, with the instruc- 
tion to take one item. The advantage of this is that at least one rein- 
forcer among the selection is likely to be strong. If the individual can 
read, the reinforcers can be listed in the form of a “reinforcer menu," 
and the preferred reinforcers can be chosen in the same way that one 
would order a meal at a restaurant. 

One last point to emphasize is that it is always the individual's 
performance that tells you whether or not you have selected rein- 
forcers wisely for that individual. When you are not sure if a particu- 
lar item is reinforcing, you can always conduct an experimental test. 
Simply choose a behavior that the individual emits occasionally, 
record how often the behavior occurs without reinforcement over 
several trials, and then present a consequence following the behavior 
for a few additional trials and see what happens. If the individual be- 
gins to emit that behavior more often, then your item is indeed a re- 
inforcer. If the performance does not increase, then you do not have 
an effective reinforcer. In our experience, not using an effective rein- 
forcer is one of the most common errors of training programs. For ex- 
ample, a teacher may claim that a particular reinforcement program 
that he is trying to use is failing. Upon examination, the reinforcers 
used may turn out to be old, stale popcorn, hardened Christmas 
candy from last year, or some other item that the person doesn't 
like. No item should be assumed to be reinforcing without first being 
demonstrated to function as reinforcer for that person. In other 
words, a stimulus is defined as a reinforcer only by its effect on behavior. 


3. Deprivation and satiation 


Most reinforcers will not be effective unless the individual has 
been deprived of them for some period of time prior to their use. In gen- 
eral, the longer the deprivation period, the more effective the rein- 
forcer will be. Sweets will usually not be reinforcing to a child who 
has just eaten a large bag of candy. A puff on a cigarette would not 
likely have been an effective reinforcer for Charles had he been al- 
lowed to smoke a pack just prior to the time that Ms. Peabody 
worked with him. Playing with a purse would not have been an ef- 


einforcer for Dianne had she been allowed to play with one 
e the term deprivation to indicate 


during which an individual does 


fective r 
prior to the training session. We us 


the time, prior to a training session, 
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not experience the reinforcer. The term satiation refers to that condi- 
tion in which the individual has experienced the reinforcer to such 
an extent that it is no longer reinforcing. "Enough's enough,” as the 
saying goes. . 

Since an individual will be experiencing the reinforcer during 
the training session, satiation may occur. To prevent or delay this de- 
velopment, the behavior modifier should give only a small amount of 
the reinforcer at each reinforcement time. Ms. Peabody gave Charles 
only one puff on a cigarette each time he swallowed a pill. Dianne was 
permitted to play with the purse for only fifteen seconds after she 
emitted a desired speech response. In other cases, we have used only 
one small piece of candy, one miniature marshmallow, one piece of 
popcorn, one sip of juice, milk, or soft drink, or one small bite of the 
child's dinner per reinforcement. Another reason for using only a 
small amount of the reinforcer per reinforcement is to minimize the 
reinforcement time and thus maximize the time during the session 
that is available for training. 

Depriving people of food and other pleasant things causes con- 
cern in many circles. Everyone agrees that it's not nice to go hungry 
and that deprivation, in itself, is generally bad — if for no other reason 
than the discomfort it causes a person. If a child is slow at learning to 
talk, however, depriving him of candy or a favorite toy for a few 
hours per day does not seem unreasonable if those items can then be 
used in a reinforcement program to teach him to talk. There are cases 
in which more excessive deprivation seems justified. For example, 
Wolf, Risley, and Mees (1964) had difficulty finding an effective rein- 


forcer for getting an autistic child to wear his glasses; even candy did 
not work. It was crucial to establish this behavior, since the doctor 
had stated that if the ch 


ild did not wear his glasses he would go 
blind within a few months. The psychologists eventually established 
"glasses wearing" after depriving the child of breakfast and lunch 
and by using ice cream as the reinforcer.’ Once the behavior was es- 
tablished, it was no longer necessary to use severe deprivation to 
Maintain it. Social reinforcers were effective. 

Severe deprivation should never be used by the novice behavior 
modifier. Moreover, even highly qualified behavior modifiers should 
use it only when it is clearly justified on ethical and legal grounds. 


(See Chapter 29 for a discussion of the ethical issues involved in be- 
havior modification.) 


Often, the natural 
dividual’s daily activiti 
In a project devoted t 
talk, we have f 
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If the individual fails to earn lots o i i 
session, it may be because he didn’t go ba dbp enge Rino 
period of time and it was therefore not effective. There ma pri 
things wrong with the procedure, but these will be on oe 
The important thing to remember at this stage of the game is dest ad 
the individual undergoes many learning trials without earnin a 
nificant amount of the reinforcer, then something should be on e] 
You should not conclude that there is something wrong with th qm 
dividual, but rather that there is something wrong with the EE 


forcers or the procedures. 


4. Immediacy 


For maximum effectiveness, a reinforcer should be given imme- 
diately after the desired response. Recall that Ms. Peabody closely fol- 
lowed this rule when she was working with Charles. A di cm dd 
forcer strengthens any response that it immediately follows. If Ms 
Peabody had dallied in reinforcing Charles, then the cigarette uff 
might have followed some response other than pill sat sett 
instance, scratching. If this had happened, then in the future Charles 
would likely scratch a lot but wouldn’t necessarily swallow his pills 
That the failure to reinforce immediately can cause other behaviors t 
occur is exemplified in Figure 2-3. 

Sometimes it is possible to get an individual (who can follow in- 
structions) to work for delayed reinforcement. Telling a child that if 
she cleans up her room in the morning her father will bring her a to 
in the evening is sometimes effective. Of course, some people "d 
work for very long delayed goals, such as college degrees. But even 
for normal and above average individuals, delayed reinforcement is 
much less effective than immediate reinforcement. In fact, 


generally 
responding for delayed reinforcement is something that often has to 
be painstakingly taught to young children and severely retarded 


havior modifier starts with immediate reinforcement 


people: the be 
trials slowly increases the time interval between the 


and over many 
response and the reinforcement. 
Some kinds of reinforcers — for instance, a movie, a picnic, or a 
, 


dance—are inconvenient to deliver immediately after a desired re- 


sponse. We'll discuss a solution to this problem in Chapter 9. 


5. Instructions 


In order for reinforcement to increase an individual’s behavior, it 
is not necessary that that individual be able to talk about or indicate an 
understanding of why he was reinforced.° It will probably help speed 
up the process if he does understand, but the principle of reinforcement 
works even when he does not. After all, the principle has been shown to 
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1. 

JOHNNY 1S PICKING UP HIS TOYS, 2. 
20 MINUTES LATER 
(WHILE JOHNNY 15 
WATCHING TV), 
MOTHER ENTERS 


OH, JOHNNY... YOU 
PICKED UP YOUR 
TOYS SONICELY! 


J 


3. 3 MONTHS AND MANY 
SIMILAR TRIALS LATER. 


JOHNNY, HOW COME 
YOU WATCH T.V. So 
MUCH AND YOU 
NEVER PICK UP YOUR 
Toys ANYMORE? 


ie 


; even in the severely and 

instructions should generally be 
he process for individuals who un- 
lp to teach individuals to follow in- 


Ms. Peabody told C 


: harles that h ] i ff 
9n à cigarette if he swallowed his RE e 


Pill, this may or may not have 
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speeded up the effect of the reinforcement procedure, but it probabl 
did teach Charles something about following instructions. It mere d 
helped him to respond appropriately the next time he was told, "If bu 
do X, I will give you Y.” í 

One should always behave in a manner that is consistent with 
the instructions she gives. If Ms. Peabody had given Charles a puff 
even when he did not swallow his pill, or if she had failed to give 
him a puff when he did swallow it, the unfortunate result would 
have been that Charles would have learned not to follow instructions 
Why should he, if what the staff member says has little or no relation 
to what she does? 


6. Weaning the student from the program and 
changing to natural reinforcers. 


After we've strengthened a behavior through proper use of positive 
reinforcement, it may then be possible for reinforcers in the natural 
environment to take over the maintenance of that behavior." For ex- 
ample, we have found it necessary to use reinforcers such as candy 
and meals to strengthen "picture naming" in behaviorally retarded 
children. However, when the children leave the project and go back 
to their wards at the institution, they often say the words that they 
have learned and receive a great deal of attention from the aides. 
Eventually, the candy and meals may no longer be needed. This, of 
course, is the ultimate goal of any training program. The teacher* 
should always try to ensure that the behavior being established in a 
ining program will be reinforced and maintained in the natural 


tra 
blem is discussed in much more detail in 


environment. This pro 
Chapter 11. 


CEMENT: HOW IT WORKS 
E WHO ARE IGNORANT OF IT 


Those who are aware of the principle of positive reinforcement can 
use it to bring about desirable changes in behavior. The principle op- 
erates equally well for those who are not aware of it. Unfortunately, 
those who are not aware of it are apt to use it unknowingly to 


strengthen undesirable behavior: Table 2-2 presents some exam- 
ples of how positive reinforcement may work against us in the long 
run. 

*Throughout this book, the word teacher is sometimes used to refer to the individual 
(parent, teacher, nurse, aide, or whomever) who is helping someone to overcome a be- 
havior problem. The word student is frequently used to refer to the individual who 
has the problem. Unless prompted otherwise, please do not think just of a typical 
classroom situation when you read about teachers and students in this book. 


TABLE 2-2. Examples of Positive Reinf 


SITUATION 


1. A three-year-old 
child who has 
been playing qui- 
etly with her col- 
oring book gets 
up and looks 
around the living 
room. 


2. While getting 
ready for work in 
the morning, a 
man cannot find 
his clean shirt. 


3. A father is busy 
ironing, and his 
two young chil- 
dren are playing 
quietly. 


4. Mother and child 
are shopping ina 
department store. 


5. Severely retarded 
residents are eat- 
ing their meal in 
the dining room 
at an institution. 


6. Father is watch- 
ing a Stanley Cup 
Playoff hockey 
game on TV. 


7. Ata Party, a hus- 
band becomes 
sullen and shows 
signs of "jeal- 
OUSy" when his 
wife is dancing 
flirtatiously with 
another man. 


RESPONSE 


The child goes over 
to the TV and begins 
fiddling with the 
dials. 


He hollers loudly, 
"Where in the hell is 
my shirt?" 


One child hits his 
little brother over 


the head with a toy 
truck. 


Child begins to 
whine, “I want to go 


home; | want to go 
home." 


One girl holds up 
her empty glass and 
grunts loudly, 
'Mmmmm, 
mmmmm, 
mmmmm." 


Two of the kids are 
playing in the same 
Toom and are being 
extremely noisy. 


The husband angrily 
leaves the party, 


IMMEDIATE 
CONSEQUENCES 


Mother immediately 
comes over to her 
and says, “I guess 
you're tired of play- 
ing by yourself; let's 
go for a walk." 


The wife immedi- 
ately finds the hus- 
band's shirt. 


Father stops ironing 
and sits down to 
play with the child 
for a while. 


Mother is embar- 
rassed and leaves 
the store immedi- 
ately with the child 
before making her 
purchase. 


One of the staff 
members immedi- 
ately comes and fills 
the glass with milk. 


Father gives them 
each a quarter so 
that they will go to 
the store and not 


interfere with his TV 
watching. 


The wife immedi- 
ately follows him, 
Showers him with 
attention, and con- 
vinces him that 
everything is OK. 


LONG TERM 
EFFECTS 


The chances of the 
child fiddling with 
the TV dials in the 
future increases 
because of the 
attention from 
mother. 


In the future, the 
husband is more 
likely to holler and l 
swear when he can't 
find his clothes. 


The child is more 
likely to belt his little 
brother in the future 
in order to gain 
father's attention. 


Child is more likely 
to whine in a similar 
situation in the 
future. 


The girl is likely to 
hold up her glass 
and make similar. 
noises in future situ- 
ations when she 
wants milk. 


The kids are more 
likely to play very 
noisily when father 
is watching TV in. 
similar situations in 
the future. 


The husband is 
more likely to show 
jealousy and leave. 
parties in similar sit- 
uations in the future. 
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In our experience, the vast majority of undesirable activities of 
behaviorally deficient individuals is due to the social attention that 
such behavior elicits from aides, nurses, peers, teachers, parents, doc- 
tors, and others. This may be true even in cases where one would 
least expect it. Consider, for example, autistic and retarded children 
who exhibit extreme social withdrawal. One behavioral characteristic 
of such children is that they avoid looking at a person who is talking 
to them. Frequently, they move away from approaching adults. We 
might conclude that they don’t want our attention. Actually, the 
withdrawn child’s behavior probably gains him more social attention 
than he would get by looking at the adult. In a case like this, it is 
only natural for adults to persist in attempting to get a child to look 
at them when they speak to him. Unfortunately, this behavior is 
likely to reinforce the child’s withdrawal behavior. The tendency to 
shower him with attention is sometimes maintained by the theory 
that the child needs social interaction to “bring him out of his with- 
drawn state.” In reality, an appropriate treatment might involve 
withholding social attention for withdrawal behavior, and presenting 
it only when the child engages in some sort of social-interaction be- 
+—such as looking in the direction of an adult who is attempt- 
ct with him. The hard work of one aide or nurse using 
behavior techniques can be greatly hindered, or com- 
pletely undone, by others who are reinforcing the wrong things. For 
example, an aide who attempts to reinforce eye contact in a with- 
drawn child is probably not going to have much of an effect if other 
people who interact with the child consistently reinforce looking- 
away behavior. Likewise, if the nurses responsible for giving Charles 
his pills had persisted in reinforcing him (with pleading and other 
types of social attention) for spitting them out, the good work initi- 
ated by Ms. Peabody would inevitably have been undone. 


havio 
ing to intera 
appropriate 


GUIDELINES FOR THE EFFECTIVE APPLICATION OF 
POSITIVE REINFORCEMENT 


The following guidelines are offered for the use of parents, teachers, 
mental retardation workers, and other individuals who wish to uti- 
lize positive reinforcement to increase occurrences of a particular be- 


havior. 


havior to be increased. As we indicated earlier in this chap- 
ter, the behavior selected should be a specific behavior (such as smiling) 
rather than a general category of behavior (such as socializing). Also, if 
possible, select a behavior that will come under the control of natural re- 
inforcers after it has been increased in frequency. Finally, as shown in 


1. Selecting the be. 
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Charles's case, in order to accuratel 
forcer it is important to kee 
to your program. 


y judge the effectiveness of your rein- 
P track of how often the behavior occurs prior 


- Selecting a reinforcer. 


a) If possible, complete the reinforcer survey presented in Figure 2-2 and 
select strong reinforcers that: 


(1) are readily available; . 

(2) can be presented immediately following the desired behavior; 

(3) can be used over and over again without causing rapid satiation; ; 

(4) do not require a great deal of time to consume (if it takes a half- 
hour to consume the reinforcer, this minimizes the training time). 


b) Use as many reinforcers as feasible, and, where appropriate, use a re- 
inforcer tray or menu. 


- Applying positive reinforcement. 


a) Tell the individual about the plan before starting. 


b) Reinforce immediately following the desired behavior. 
c) Verbally describe the desired behavior to the i 


inforcer is being given. (For example, say, ‘You cleaned your room 
very nicely" and not, "You're a good boy.") 

d) Use lots of Praise and physical contact 
reinforcing to the individual) 
ever, in order to avoid satiati 
inforcers. Don't alw 


ndividual while the re- 


on, vary the phrases you use as social ger 
you." (Some sample phrases: 
; "Tremendous."') 

gram (discussed more fully in Chapter 11). 


a dozen or so of the opportunities, a be- 


; it might be possible to 
as candy and toys) and 


ed frequency is being maintained, plan pe- 
i program has terminated. 


Study Questions 


(for examination purposes) 


Í; 


How did Ms, Peabody know that instructions and force feeding wouldn't 
8et Charles to swallow his pills? 

Was Ms. Peabody Tecording the frequency, quality, or duration of 
Charles’s Pill-swallowing behavior? 


What are the two Parts of the Principle of Positive reinforcement? 


33 4. 
. Should you tell an individual with whom you are using reinforcement 
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un 


10. 


Ti. 


19. 
20. 
21: 


In what way is positive reinforcement like gravity? 


about the reinforcement program before putti ud 
why not? putting it into effect? Why or 


. What is the best way to determine if something is reinforcing for some- 


one? (See p. 25.) 


. Why did Ms. Peabody give Charles only one puff on a cigarette after 


each desirable response, rather than giving him the whole cigarette? 
List the two reasons for using a small amount of the reinforcer per rein- 
forcement. 
Is it correct to conclude that a withdrawn child does not like attentio 
from other people? Explain. a 
"A stimulus is defined as a reinforcer only by its effec! i 

3 à t on beh a 
(p. 25). Explain what this means. MEN 
How might you conduct a test to determine if the social attention of a 
particular adult is or is not reinforcing for a withdrawn child? 


Should severe deprivation ever be used? Explain. 


. What should you conclude if an individual does not earn much of the re- 


inforcer during a training program? (See page 27.) 

What do we mean by the natural environment? By natural reinforcers? 
Briefly, what are six factors that influence the effectiveness of reinforce- 
ment? 

Why is it necessary to be specific when selecting a behavior for a 
reinforcement program? 

Ideally, what four qualities should a reinforcer have (besides the neces- 
sary quality of functioning as a reinforcer)? (See p. 32.) 

Describe two examples of positive reinforcement that you have encoun- 
tered, one involving a desirable behavior and one involving an unde- 
sirable behavior. For each example, identify the situation, behavior, im- 
mediate consequence, and probable long-term effects (as shown in 
Tables 2-1 and 2-2). (The examples should not be from the text.) 

What is plotted on the vertical axis in Figure 2-1? 

What is plotted on the horizontal axis in Figure 2-1? 

Note that the distance between any two numbers on the vertical axis in 
e 2-1 is less than half of the distance between the same two num- 
bers on the horizontal axis. Redraw the graph so that the scale on the 
horizontal axis is the same as the scale on the vertical axis. How does the 
appearance of your graph differ from that of Figure 2-1 on p. 19? 


Figur 


Study Exercises 
(to be practiced by the reader) 


1: 


For a fifteen-minute period during which you spend a good deal of time 
around children, carry a pencil and a small slip of paper with you. On the 
front of the paper, put a small mark each time you interact with (i.e., talk 
to, look at, or touch) a child immediately following a desirable behavior of 
the child. On the other side of the paper, put a small mark each time that 
you interact with a child immediately following an undesirable behavior 
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- List ten different phrases that you 


of the child. At the end of the fifteen-minute period, count up beng ec hig 
on each side of the paper. We hope your instances of interaction oe 
ing desirable behavior are five or six times as many as the itera ee 
following undesirable behavior. If they are not, then we would enco 

you to continue this daily exercise until this goal is reached. 


i r kind 
2. How many times do you dispense social approval (nods, smiles, or kind 


words) to children during a day in which your total time with them is = 
least one hour. How many times do you dispense social disapprove’ 
(frowns, harsh words, etc.) during a day? Again, use a small piece of pa 
per and a pencil and record the instances in which you dispense so a 
approval and those in which you dispense disapproval. Ideally, your = 
cial-approval total at the end of the day will be four or five times the aan 
cial-disapproval total. We would encourage you to continue this daily ex 
ercise until you have achieved this ratio,* 


; iastic 
might use to express your enthusiasti 


approval to an individual. Practice varying these phrases until they come 


naturally to you. 


Self-Modification Exercises 


1. Try to watch your own behavi 


- Complete the reinforcer 
. Assume that someone ( 


in learning is E. L. Thorndike who in 18 i 

the behavior of a hun earning to pull a ied a 
Cage and acquire fo 
(Continued) 


(to be practiced by the reader) 


or for five one-minute periods while behav- 
each minute, describe a situation, a specific 
behavior, and the immediate consequences of that behavior, Choose be- 
haviors whose consequences seemed pleasant (rather than neutral or un- 
pleasant). 


ing naturally. At the end of 


questionnaire (Figure 2-2 
your husband, wife, 
viors (such as maki 


) for yourself. 

friend, etc.) is going to rein- 
ng your bed daily, talking in 
Pages of this book). Select the 


Pleted questionnaire that best satisfy the 
electing a reinforcer. 


force one of your beha 


two reinforcers from 
above guidelines for s 


rewards bot 


h knowin 
rded history. 


with experimentally identifyin 
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fect," which stated in part that if a stimulus was followed by a response 
and then by a "satisfier," the stimulus-response connection was 
strengthened. It was clear from Thorndike's other writings that a ‘‘satis- 
fier" was what we are calling a positive reinforcer. B. F. Skinner, one of 
the most influential psychologists of modern times, suggested later that 
the term positive reinforcement was preferable to terms such as satis- 
fiers and rewards. Skinner described his reasons for introducing a new 
term, positive reinforcement, rather than continuing with terms such as 
reward, which were borrowed from the layman's everyday vocabulary 


(Skinner, 1938, p. 7): 


The important objection to the vernacular in the descripti ayo 
that many of its terms imply conceptual schemes. | He ee d 
science of behavior is to dispense with a conceptual scheme but that it 
must not take over without careful consideration the schemes which un- 
derlie popular speech. The vernacular is clumsy and obese; its term over- 
lap each other, draw unncessary or unreal distinctions, and are far from 
being the most convenient in dealing with the data. They have the dis- 
advantage of being historical products, introduced because of everyday 
convenience rather than that special kind of convenience characteristic of 


a simple scientific system. 


For additional discussion of the concept of positive reinforcer, see Skin- 
ner (1953, pp. 72-73). uem essem 


What is scientific psychology? The best answer to this question 
might be found by examining the behavior of psychologists who con- 
sider themselves scientists. Although there is a good deal of agreement 
among individual scientific psychologists concerning the general char- 
acteristics of scientific psychology, there is also some disagreement. 
Some individuals have argued at length about what science and psy- 
chology are and are not. Other individuals, many of whom have never 
conducted experiments or participated in other scientific activities, have 
made proposals concerning the manner in which scientific psychology 
should proceed. (These individuals are often called philosophers of 
science.) For a more detailed discussion of the particular brand of sci- 
entific psychology subscribed to in this book, see Skinner (1953 

p. 4-22: 1961, pp. 76-100) and Sidman (1960). This approach, gen- 
erally called the "experimental analysis of behavior," emphasizes the 
value of studying the effects of manipulable aspects of the environment 
on observable behavior of individual organisms. Its immediate goals are 
to improve our prediction and control of the behavior of individual or- 
ganisms. An additional goal is to improve our explanations of observed 
behavior. There are, however, different kinds of explanations. This par- 
ticular approach emphasizes the importance of two types of ex- 
In one sense, a behavior is thought to be explained when it is 
o demonstrate its controlling variables. In a second sense, a 
behavior is explained (or interpreted) when it is possible to identify 
demonstrated functional relationships between similar behaviors and 
their controlling variables. Much of Skinner's writings (e.g., 1953, 1957, 
1969) consist of explanations of this second type. 


planation. 
possible t 


An interesting example of the application of activity reinforcers was 
described by Pierce and Risley (1974). They were concerned with in- 
creasing the membership at a community recreation center in the most 
economically deprived area of Kansas City, Kansas. Since a number of 


(Continued) 
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children were already attending the center on a voluntary basis, it was 
assumed that recreation activities were reinforcing for those individuals. 
In order to demonstrate this and at the same time solve the problem of 
increasing the membership, Pierce and Risley used extra recreation time 
as a reinforcer. An extra hour of time for recreation activity was allowed 
for a member each time he enrolled a new member in the center. The 
result was a dramatic increase in the number of new members. 


Notice that in the experiment by Wolf et al., the autistic child initially 
Performed best only when he was deprived of food and food was used 
as a reinforcer. Earlier experiments led Psychologists to postulate hun- 
ger drives and thirst drives as essential components of learning when 
food and water were used as reinforcers. Psychologists also postulated 
a variety of other drives, such as a drive for approval and a drive for 
novelty, that were thought by many to be necessary for learning to oc- 
cur. For a more detailed discussion of some of the traditional views of 
the relationship between drive and learning, see Kimble (1961). In gen- 
eral the behavioral approach adopted in this 


hypothesizing internal conditi 


can be found in Skinner (1953, pp. 141—149). 


think of people learn- 
eople being reinforced with- 
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(Continued) 
without awareness does indeed occur—it sh i 

itho i 1 ould be poi 
this is not a settled issue in the eyes of some eRe anes nes we 
that the issue is not as clear-cut as we have described it above (f o: 
ample, see Dulany, 1968). A discussion of awareness as Benavinnitet 
develops in the same way as other behaviors can be found in HE. 


(1975). 


Many behaviors in everyday life are followed b i 

though no one specifically or deliberately prdor CIRCE Ho 
increase or maintain the behavior. Reading signs is frequentl Rer: 
forced by finding desired objects or directions. Eating is ASR ae 
the taste of food. Verbal and social behaviors are reinforced b I % 
ural reactions of others. Typically occurring events in Ode ja He 
function as reinforcers are referred to as natural raintorcen E 
events may be deliberately manipulated by psychologists ical ash 
others to modify behavior, and in such cases they would be oeste ipo 
as arbitrary, contrived, or programmed reinforcers. They are Salis] i 
ural reinforcers when they occur as consequences of behavior i n 
natural environment. For a more detailed discussion of natural $ s 
arbitrary reinforcers, see Ferster (1967) and Ferster, Culbertson E 


Boren (1975). 

Many studies in the literature have demon indivi 
who are unaware of the effects of cuiu rir AME 
knowingly strengthen undesirable behaviors by providing social A 
tention as a reinforcer following those behaviors. A classic example wa 
the early study by Zimmerman and Zimmerman (1958), in which NAE 
ers unknowingly maintained extreme tantrums in a child by attending to 
tantruming behavior. Another classic study, conducted by Harris e 
and Baer (1966), demonstrated clearly that nursery school teachers de 
knowingly maintained such behaviors as excessive crawling, crying and 
whining, isolate play, and excessive passivity by attending to those be- 
haviors in their children. The authors of this study taught the teachers to 
ignore such behaviors and to attend to desirable alternative behavio 
The results in all cases were successful in increasing alternative desir. ble 
behaviors and decreasing the undesirable behaviors. In addition, a B : 
room study by Hall, Lund, and Jackson (1968) indicated that Rent OR 
from teachers maintained disruptive activity in children to the extent 
that the activity interfered with desirable study behavior. Finally, a T 
by Hall and Broden (1967) indicated that undesirable behaviors in TA 
injured children might be maintained by attention from well-meaning 


but uninformed adults. 

ratio of reinforcers to reprimands has not been 
However, there is some support for our recommen- 
se 2 that a ratio of approval to disapproval should 
ne source of support for this recommendation 
comes from an investigation by Stuart (1971) concerning the dispensing 
of verbal approval and disapproval by parents to their juvenile- 
delinquent offspring. Stuart reported that juvenile deliquents and their 
parents tend to verbally “reinforce” each other approximately as often 
as they verbally disapprove of each other. Conversely, nondeliquents 
and their parents showed ratios of approval to disapproval towards 
each other of about 4 to 1. Similarly, Madsen and Madsen (1974) ob- 
served that teachers in classroom situations who disapproved of stu- 
dent behaviors about as often as they praised student behaviors had 


(Continued) 


The appropriate 
widely investigated. 
dation in study exerci 
be about 4 or 5 to 1. O 
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(Continued) 


higher frequencies of classroom discipline problems than teachers who 
dispensed praise much more often than criticism. Moreover, a traing 
program provided by the Madsens for teachers with discipline problem 
led to an increase in the ratio of praise to criticism for those teachers to 
a 4-to-1 level or higher, and produced better-behaved classes. 


Study Questions on Notes 


1. Who is given credit for being the first to experimentally identify the 
principle of positive reinforcement? 


2. State the "law of effect." 


3. Why did Skinner introduce the term positive reinforcement rather 
than using the common-sense term reward? 

4. Briefly describe a situation 
ing but should not, technically, call reinforcing. Explain. 

5. What two types of explanations are emphasized by the behavioral 
Pals Describe an example of each from this chapter (see pp. 18 
and 31). 


Or experience that we might call reward- 


6. Why is “minimal brain dysfunction” not Presently an acceptable kind 
of explanation for a behavior deficit? ( 


i ? (Compare note 2 in Chapter 1 with 
note 2 in this chapter.) 


7. What is awareness? (Hint: Recall the discussion about behavior in 
Chapter 1.) 

8. Discuss evidence that people's behavior can be modified without 
their being aware of it. 


9. Describe three behavior episodes in 
reinforcers. Justify your choices. 


10. What did Harris, Wolf, and Baer do? 


11. How did Pierce and Risle Solve the m i a com- 
munity center? y embership problem at 


this chapter that involved natural 
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Decreasing 
A Behavior With 


EXTINCTION 


“Peter, your tantrums are driving me crazy.” 


PETER'S CASE 


Peter, a ten-year-old boy diagnosed as autistic, i : 
toba School' One summer, he participated apa Venen s iren 
program in which university students, under the supervision a itioning 
authors, attempted to teach him to talk and to engage in som p the 
dergarten activities. One of the main problems encountered w e basic kin- 
frequently threw severe tantrums, during which he sta =e that Reter 
screamed, threw things, slapped his face, cried, and pos pose: 

‘ ut," 


d on a study by Martin, England, Kaprowy, Kilgour, and Pilek (1% 
: bò) 


*This report is base 
ge government institution for retarded people in tl 
he pro 


The Manitoba School is a lar, 
vince of Manitoba. 
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“Needle,” or “Doctor” while Pointing to his arm, leg, or some other part 2 
his anatomy. These tantrums appeared to be provoked by mildly frustra 
ing events—for instance, when he was prevented from leaving the room, 


or when he failed to receive a reinforcer after emitting an incorrect verbal 
response. 


Sessions were initially conducted in 


a small room. Peter sat in a be 
arm-chair desk which was placed against the wall so that he was prevente 
from wandering around. Whenever Peter 


to begin working on developing his verbal 
of the procedure are Shown in Figure 3-1. 


ike that of Positive reinforcement, has two 
ation, Somebody emits a previously rein- 
the response is not followed by the usual re- 
inforcing consequence, then (2) that person is less likely to do the 


encounters a similar situation. Stated 


: i quency. In a general sense, if the 
environment ignores a behavior, then that behavior will go away.' 
navior on the ward indicated that he 
ial attention from ward staff when he 
this attention was a positive reinforcer 
ency of this undesirable behavior. In 
, Peter's tantrums no longer received at- 
ecreased to a very low level, As with 
W of us are aware of just how frequently 


here. Over a number 
"pay off gradually decrease. Of 
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Undesirable Responses 
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Sessions 


FIGURE 3-1. Extinction of undesirable verbal responses 7 

Each instance of Peter's "Cut," "Needle," or "Doctor" shui E 
undesirable response. Each dot represents the number of undesirable re- 
sponses in a session. A tantrum consisted of several such responses as 
well as crying, whining, and face slapping. The frequency of tantrums during 
the first nine sessions would therefore be somewhat less than the frequency 


of verbal responses. 


course, this is highly desirable, for if we persisted in useless behav- 
ior, we would quickly "extinguish" as a race. 

Extinction, like the principle of positive reinforcement, has been 
studied extensively by experimental psychologists over several 
decades, and we are able to describe a number of factors that 
influence its effectiveness. These will now be discussed. 


FACTORS INFLUENCING THE EFFECTIVENESS OF EXTINCTION 


1. Extinction combined with positive 
reinforcement 


Extinction is most effective when combined with positive rein- 
forcement for some desirable alternative behavior. Thus, not only were 
Peter's tantrums ignored (extinction), but the behavior "sitting qui- 
etly" was positively reinforced. The combination of the two proce- 
dures probably decreased the frequency of the undesirable behavior 
much faster (and possibly to a lower level) than would have been the 
case had the extinction procedure been used alone. 

It is often impractical to reinforce a child every few seconds for 


TABLE 3-1. Examples of extinction 


IMMEDIATE LONG TERM 
SITUATION RESPONSE CONSEQUENCES EFFECTS 
i i The child is less 
four-year-old The child begins to The Parents and j " 
x erm is ying in make loud animal guests ignore the likely to make ani 
bed at night noises while lying in child completely and mal noises in future 


while the parents bed. 


continue to talk qui- situations of that 
are sitting in the 


etly. sort. 
living room talk- 
ing to guests. 

2. The next evening, The child holds up The parents con- The behavior of 
the same child her empty plate and tinue talking and demanding dessert 
and parents are yells loudly, "Des- ignore the child's is less likely to — 
having dinner at sert, dessert, des- loud demands. After occur in similar situ 
the dining-room sert." the child sat quietly ations in the meua 
table. The child for a brief period, and the behavior a 
has just finished the mother served waiting quietly unti 
the main course. dessert. dessert is served is 

more likely to occur 
in similar situations 
in the future. 

3. A husband is The husband contin- The wife goes about Continual (and prob- 
standing in the ues to standin the — the business of Pre-  ably unproductive) 
kitchen and com- — kitchen and com- paring supper and complaining by the 
plaining to his plain about the traf- does not attend to husband is less 
wife about the fic, any of his com- likely to occur in the 
traffic on his way ments. 
home from work. 


future. 
The wife says, 


"Yes, that's too 
bad. Why don't 
you sit down and 
rest and you'll 
feel better." 


4. A child in a 


The child begins to 
grade-three 


The teacher igno 
Snap his fingers. Mores 


The child is less 


the child and likely to snap his fI?" 
peer acad responds to those ate in similar situ- 
assignment and Children who raised ations in the future 
ria m der their hand and are 
; not snapping their 
fingers. 

S a eee bog Child pounds The piece still The likelihood of the 
apase noon the plece to try to doesn't fit; it merely child's aggressive 
stlempting io e e it fit. bounces every time pounding occurring 
s ag to it is pounded. in similar situations 
Wrong place. e AS 


decreased. 


re | 
EI alc FRE 
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engaging in some desirable behavior (such as sitting or playing qui- 
etly) in place of disruptive behavior. It is possible, however, to begin 
with short intervals of desirable behavior and gradually e 
them to longer, more manageable intervals. For example, a child who 
is engaging in inappropriate crying could be ignored until he had 
stopped crying for a period of ten seconds. At the end of the ten-sec- 
ond interval, he could be reinforced with praise and perhaps a small 
bite of candy. On subsequent trials, the teacher could require succes- 
sively longer periods of silence— fifteen seconds, then twenty-five 
than a minute, and so on— before presenting reinforcement. It is im- 
ant that the increase in the requirement be very gradual; other- 
the undesirable behavior will not decrease very rapidly. Also 
be taken not to present the reinforcer immediately after the 
as this would tend to reinforce the crying, thereby in- 


port 
wise, 
care must 
crying ceases, 
creasing rather than reducing it. 


2. Controlling alternative reinforcers for the 
behavior that is to be decreased 


Suppose à four-year-old girl, Susie, has developed a great deal of 
whining behavior, especially in situations in which she wants some- 
thing. Her mother has decided to ignore this behavior in the hope 
that it will go away. On three occasions during the afternoon, mother 
ignored the whining behavior until it ceased, and then, following a 
brief period of no whining, provided Susie with the item she de- 
sired. Things seemed to be progressing nicely until early evening 
when father came home. While mother was in the kitchen, Susie ap- 
proached mother and in a whiny tone asked for some popcorn to eat 
while watching TV. Although mother completely ignored Susie, fa- 
ther entered the room and said, “Mother, can’t you hear your child? 
Come here, Susie, I'll get your popcorn.” We are sure that you can 
now predict the effect this episode will have on Susie's whining be- 
havior in the future (not to mention mother’s anger towards father). 

It is extremely important during the application of extinction to 
ensure that alternative reinforcers (reinforcers other than those you 
are withholding) are not presented following the occurrence of the 
undesirable behavior. Failure to do this can doom your extinction 
program, as shown in Figure 3-2. 

Reinforcers presented by other people or by the physical envi- 
ronment can undo your good efforts at applying extinction. Unfortu- 
nately, it is often very difficult to convince others of this if they are 
not familiar with the mechanics of positive reinforcement and ex- 
tinction. For example, if several psychiatric nurses are ignoring a 
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I THINK I'LL IGNORE 7 
UOHNNY S COOKIE ^ 3MONTHS AND MANY 
TATING: AND EXTINGUISH COOKIES LATER 


GEE, L WONDER WHY 3 
EXTINCTION DIDN'T WORK! 


Psychiatric nurse enters p 
Says, "Oh, I can get this child to stop Crying — here, Tommy, m 
candy,” then Tommy is likely to stop crying at that moment, but i 
the long run his cryj ill i 


frequency because of that adi 
Tommy to stop crying, how 
onvince her of the importance 
Ssary either to control the be 


inforced trial. Sin 
ever, it would pro 
of extinction. In 
havior of these o 
extinction proce : Frequently, the latter is more 
feasible than the former? 
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distress, and other forms of discomfort. We suggest that any behavior 
must be examined closely in terms of the desirability of decreasing it. 
If a decrease is desired, then extinction, along with positive rein- 
forcement of an alternative behavior, frequently provides the right 


route to travel. 


3. The setting in which extinction is carried out 


The settings in which the extinction procedure is used can range 
from highly contrived situations for hard-to-eliminate behavior to ev- 
eryday situations for behavior that is eliminated more easily. For an 
example of the latter, consider retarded children who run up to adults 
entering the ward of an institution and throw their arms around 
them or cling to their clothing. This behavior appears to be rein- 
forced by the attention received from the adults as they attempt to 
free themselves from the child’s grasp without “hurting his feelings.” 
The behavior can be greatly reduced over time if the adults ignore the 
children who are engaging in it and give plenty of attention to the 
children who are politely standing a slight distance away. 

The necessity of using extinction combined with reinforcement 
in a highly contrived situation is illustrated by the following case of a 
self-abusive child (Martin and Treffry, 1970). Valerie was a sixteen- 
year-old severely retarded girl with cerebral palsy and partial right 
hemiplegia (that is, she was partly paralyzed on her right side). She 
had been at the Manitoba School for eight years prior to the treat- 
ment to be described. She had no speech, and although she had been 
taught to walk with support four years earlier, she would not move 


s aided by staff. When a staff member let her go, she simply 
oor. Two of the undesirable behaviors she emitted 


ace with her strong left hand and, when placed on a 
chair, slouching so that she was almost parallel to the floor. Many 
treatments other than behavior modification had been tried during 
the previous eight years, but none had been effective. As a result of 
extensive observations over a two-month period, it became obvious 
that staff attention, which occasionally followed her self-abusiveness 
and slouching, was maintaining those behaviors at a high frequency. 
It was decided that a special setting was necessary before an attempt 
could be made to extinguish these behaviors, because the staff mem- 
bers were used to attending to Valerie in the natural ward setting. 
Therefore, the following procedure was initiated. In the morning, af- 
ter Valerie was dressed, the staff would take her to the TV room and 
sit her on a chair that was positioned behind a sofa that had been 
placed across a corner of the room. Valerie was thus confined to the 
corner. A piece of cardboard was then placed vertically on the sofa. If 
Valerie sat erect on the chair, she was just visible above the card- 


unles 
dropped to the fl 
were hitting her f. 


46 board. However, if she positioned herself in the undesirable fashion 
Basic previously described, she could not be seen. Throughout the day, 
Behavioral with the exception of mealtimes, the psychiatric nurses looked to- 


are T coediuda wards Valerie's corner approximately every fifteen minutes. If on 
those occasions Valerie was sitting up looking over the sofa and card- 
board and not slapping herself, she 
candy, or fruit. However, if she cou 
but was slapping herself, 
created a situation in which 
sitting erect without slappi 
slouching in her chair or for 


The case of Valerie illustrates one reason for considering the 


to be carried out. There is another one. 


Baseline Final Conditioning Period 


Follow-Up 
(Nov.,/68) (Jan. 30 ~ Feb. 20,/69) 


(July, /69) (April, /701 
100 - 


| " 


Percentage of Time Spent 

Sitting and Not Slapping 
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It would probably be unwise, for ex i 
tinction of her child's temper mls oS Esa 
store. The child is likely to display behavior in the de doe nien it 
such that the nasty looks from other shoppers and Fic vip e 
decrease the chances of mother carrying through A S ET yc 
words, it is important to consider the setting in which m ini 
be carried out, in order to (1) minimize the influence of Mere ee 
reinforcers on the undesirable behavior to be adini mdi (A 
maximize the chances of the behavior modifier persisting der T 
e 


program. 


4. Instructions 


Although it is not necessary that an individual be able to talk 
bout or understand extinction, it will probably help speed u is cd 
crease in behavior if the person is initially told something [^ pod 
“Bach time you do X, then Y (the reinforcing item) will no Hunde S 


cur." The points regarding instructions that were made in Chapter 2 
12 


apply equally well here. 


5. Extinction is quicker after 
continuous reinforcement 


e another look at the case concerning Susie's whining be- 
Before mother decided to introduce extinction 
what happened when Susie was whining? Sometimes nothing veut 
happen, because mother would be busy with other things, such as 
talking on the telephone. But at other times (often after five or six in- 
stances of whining), mother would attend to Susie and give her what 
she wanted. This is typical of many reinforcement situations in that 
it is clear that Susie was not reinforced following each instance of 
whining. Rather, she was reinforced occasionally, following several 
instances of whining. This type of situation is referred to as inter- 
mittent reinforcement, as opposed to continuous reinforcement, and 
is discussed in detail in Chapter 5. It is necessary to mention these 
two schedules of reinforcement here because the schedule can greatly 


influence the effectiveness of extinction. 
inforcement schedule on extinction can 


The influence of the ret 
easily be imagined if you consider a situation that you yourself have 
probably encountered many times. Suppose you are writing with a 
ball point pen and suddenly it stops writing. What do you do? Like 
most people, you probably shake it up and down a couple of times 
and try to write with it a few more times, and if it still doesn't write, 
you throw it away and get another pen. Now suppose that you are 
writing with another ball point pen in another situation. In this sec- 


Let's tak 
havior with mother. 


48 

Basic 
Behavioral 
Principles 

and Procedures 


is, you write for a while 
and then th i 
oo è l € pen misses a little bi 
rong do Es eei and write some more, and then it vendis 
SNR E iur: dud shake it, it writes a little more. Now comes the 
i En Onviailp f are you likely to persist longer in using 
? , the second situati 
ou crie ation, because the pen asion- 
SEN i oe writes again. When the Boris cles 
ion where a behavior has always been reinforced 
ori 


Now, let's t i 
S take a look at Susie's Whining. It is likely to take 


much longer for extincti 
g xtinction to completely eliminate whining if whin- 


ing sometimes “pa S 
Pays off" and sometimes does not, than if whining 
" a 1 


ly ignored. In other 


hat if yo d einforced only occa- 
siittentlp, yo to extinguish a behavior ca has 
must be prepared for extinction 


l XTIN ON: HO ORK 
l : WI 
PITFALLS OFE C Ww S 
OF | 


it unknow are not aware of ex- 
amily, ku to the desirable behavior of 
D e ers. Table 3-2 presents some 

? he long run, work to decrease 


TABLE 3-2. Examples of undesirable instances of extinction 


SITUATION 


RESPONSE 


IMMEDIATE 
CONSEQUENCE 


1. The residents and A particular resident The nurses keep on 
has been sitting qui- talking, and no one 


nursing staff in 
an institution for 
the retarded are 
sitting in the TV 
room. 


2. Two staff mem- 
bers are talking 
to each other in 
an institution for 
the retarded, and 
a resident 
approaches and 
Stands nearby. 


3. A man carrying 
Several parcels is 
walking towards 
the exit door of a 
department store. 
A woman stand- 
Ing by the door 
waiting for the 
bus sees the man 
coming. 


4. A three-month- 
old baby is lying 
quietly in the crib 
just before feed- 
ing time. 


etly for the past 
twenty minutes. 


The resident stands 
and waits patiently 
beside the two staff 
members for several 
minutes. Finally, the 
resident interrupts. 


The woman opens 
the door for the 
man. 


The baby begins 
making cooing 
sounds (which, 
might be interpreted 
by eager parents as 
"mama" or "dada"). 


responds to the 
child who has been 
sitting quietly. 


The staff members 
stop talking and lis- 
ten to the resident. 


The man rushes out 
without saying a 
word. 


The mother, busily, 
preparing a bottle, 
ignores the child. 
When the child is 
picked up later she 
is again quiet (or, 
more likely, crying). 


LONG-TERM 
EFFECTS 

The behavior of sit- 
ting quietly is less 
likely to occur in 
similar situations in 
the future, due to 
the lack of rein- 
forcement for sitting 
quietly. 


The response of 
standing beside the 
staff and waiting 
patiently is less 
likely to occur in the 
future, and the 
response of inter- 
rupting staff is more 
likely to occur in the 
future. 


The chances of the 
woman opening the 
door in similar situ- 
ations in the future 
are decreased 
slightly. 


The mother has just 
missed an opportu- 
nity to reinforce 
noise making that 
approximates 
speech. Instead she 
reinforced lying qui- 
etly (or crying). 
Therefore, cooing is 
less likely to occur 
in the future. 


de who is not familiar with the principles of posi- 
t and extinction or with the particular program for 
a child who dresses himself and many 


replaced by an ai 
tive reinforcemen 
the child. Confronted with 
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children who do not, the new aide will quite likely spend a great 
deal of time helping the latter children but giving very little attention 
to the one child. It is a common human tendency to give plenty of at- 
tention to problems and to ignore situations in which things seem to 
be going well. It is easy to rationalize this selective attention. “After 
all,” the aide may say, “why should I reinforce Johnny for doing 
something that he already knows how to do?” Despite this seemingly 
justifiable rationalization, we know that if the child’s self-dressing 
behavior receives little or no reinforcement from any source, it will 
eventually extinguish. For any particular behavior to be maintained 
after it has been established, it must continue to be reinforced. 

A different kind of pitfall is the unexpected difficulties encoun- 
tered by a behavior modifier trying to apply extinction. During ex 
tinction, behavior may increase before it begins to decrease. That is, 


things may get worse before they get better. Suppose a child in the 
classroom is constantly raisin 


or two of extinction before the 
If something is no longer ^ 
havior may be sufficient to 


tinction following finger 
this behavior during the 


conclude that extinction wasn't workin 


$ reconsider the finger-snapping 
example, we might i 

child’s finger snapping, 
louder and louder a 
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GUIDELINES FOR THE E 


Pos be prepared to "weather the storm." If an — 
ure produces mild aggression, then giving up in th Sane an Pracce 
only reinforce the undesirable behavior on : int * middle will not 
it will also reinforce additional undesirable “ilda G schedüle, 
An additional difficulty is that a E E 
decreased during an extinction session may rea ab has completely, 
portunity for the behavior to occur. This Main i tn pcdes 
guished behavior following a recess is called no STUER 
Typically, the amount of behavior that spontaneous? R Ae 
than the amount that occurred during the aai e eir dens facias 
sion. After several additional extinction sessions, s B Sxhnehon: ses- 
ery is usually not a problem. deinem 
To oversimplify this and the precedin 
if you want behavior to happen ie amen pr dips o in 
behavior to happen less often, ignore it. But beware The qms 
more to positive reinforcement and extinction than ia jo a 
eye. For maximal effectiveness in the application of po Peake id 
forcement and extinction, one should be aware of their us ar 
as the guidelines for the effective application of the two bcr de, well 
i, 


FFECTIVE APPLICATION 


OF EXTINCTION 


The following rules are offered as a check list for individual 
wish to utilize extinction to decrease a particular undesirabl » id 
ior. As with the guidelines for positive reinforcement in oh cu 
these rules are presented on the assumption that the ete Pon " 
ing them is a parent, teacher, or some other person who is oiie 


with individuals with behavior problems. 


the behavior to be decreased 

he behavior, be specific. Don’t plan a major character im 
at one time. For example, do not try to extinguich 
king behavior in a classroom. Rather, choose 
finger snapping in the classroom. 


1. Selecting 
a) In choosing t 
rovement to take place 

all of Johnny’s trou 

a particular behavior, such as Johnny’s 

b) Remember that the behavior may & 
that aggressive behavior is sometimes produced during the extincti 
rocess. Therefore, make sure that the circumstances are such that ou 

can follow through with your extinction procedure on the Behivine 
chosen. For example, be very careful if the behavior is P EAA 
the individual or others. Will it be harmful for you to persist in ee 
extinction program if the behavior gets worse? You should also ups 
the setting in which the behavior that you have selected is likely to ord 

] to extinguish temper tantrums a 


For example, it may be impractica 
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restaurant, because of obvious social pressures. that you may a 
A able to resist. If you are concerned with decreasing a partiema, e 
fundis but you cannot apply extinction because of the above consi era- 
nons do not despair. We will describe other procedures for decreasing 
behavior in later chapters. 


c) If possible, select a behavior for which you can control the reinforcers 
that are currently maintaining it. 


Preliminary considerations 


N 


a) If possible, keep track of how often the undesirable behavior rie 
prior to your extinction program. During this recording phase, o 
attempt to withhold the reinforcer for the undesirable behavior. . 
Try to identify what is currently reinforcing the undesirable behavior 
so that you can withhold the reinforcer during treatment. The reinforce 


ment history of the undesirable behavior might provide some idea of 
just how long extinction will take. 


b) 


Identify some desirable alternative behavior that the individual can 
engage in. 


Identify effective reinforcers that can be used for desirable alternative 
behavior by the individual. 


e) Try to select a setting in which the extinction can be carried out success- 
fully. 


f) Be sure that all the relevant individuals know, before the program starts, 
just which behavior is being extinguished and which behavior is being 
reinforced. Be sure that all who will be coming in contact with the in- 
dividual have been Prompted to ignore the undesirable behavior and 
reinforce the desirable alternative behavior. 

3. Implementing the plan 
a) 


a 


Tell the individual about the plan before starting. 

b) Regarding the Positive reinforcement for the desirable alternative 
behavior, be sure that the rules in Chapter 2 for putting the plan into 

effect are followed. 


€) After initiating the Program, be completely consistent in withholding 
reinforcement after all instances of the undesirable behavior and re- 
inforcing the desirable alternative behavior. 
- Weaning the student from th 


* program (discussed in more detail in Chapter 
11) 


: vior has decreased to zero, there may be 
occasional relapses, so be Prepared. 


your extinction procedure are: 
t i olding following the undesirable behavior 
1$ not a reinforcer for the child: 


is receiving intermittent reinforcement 
from another Source; 


Study Questions 
(for examination purposes) 
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N 


10. 


Tis 


12. 


13. 


14. 


15: 


16. 


What are the two parts to the principle of extinction? 
If you tell someone to stop eating candies and 
beds a the person sto i 

an example of extinction? Explain why or why not on the bi ly id 
definition of extinction. asis OF the 
When Peter ceased tantru 
onds before reinforcing 
reinforce Peter immediately 
Why did mother’s attempt t 
shown in Figure 3-2) fail? 
Describe a particular behavior you would like to decrease in a child witl 
whom you have contact. Would your extinction program require a S g 
cial setting? Why or why not? pe 
Why is it necessary to consider the setting as a factor influencing yo 
extinction program? your 
If a behavior is not reinforce: 
to it? 

Briefly describe four pitf 
Briefly explain five genera 
tinction. 

If you were recording some o 
prior to introducing an extincti 
for? 

What are the most common rea 


ming, Veronica waited for fifteen to tw 

nic e ent - 
Peter for sitting quietly. Why didn't Veronica 
after the tantrum had ceased? 
o extinguish the child's cookie eating (as 


d at least once in a while, what will happen 


alls of extinction. 
| factors influencing the effectiveness of ex- 


bservations of an undesirable behavior 
on program, what would you be looking 


sons for the failure of an extinction pro- 
gram? 
Extinction should not be applied to certain behaviors or situations. What 
types of behaviors and situations would these be? Give an example. 
Describe two examples of extinction that you have encountered, one in- 
volving a desirable behavior and one involving an undesirable behav- 
ior. For each example, identify the situation, behavior, immediate con- 
sequence, and probable long-term effects, as is done in Tables 3-1 and 
3-2. (Your examples should not be from the text.) 
The graphs in Figures 3-1 and 3-3 both show the results of a successful 
extinction program. Yet one graph shows a decrease and the other 


shows an increase. Why is this so? 
How are different experimental co 
Figures 2-1 and 3-3.) 

e Table 3-1. Which of those 


ative response? 
t for an alternative re 


nditions indicated on a graph? (See 


examples involve positive reinforce- 
For those that do not, indicate how 
sponse might be introduced. 


Examin 
ment for an altern 


positive reinforcemen 


Study Exercises 


(to be practiced by the reader) 


1. Choose a situation in which you will be able to sit and watch an adult in- 


ldren for approximately half an hour. During 


; each time you interact with any of 
the children following thei i i 
second half-hour period, 


Self-Modification Exercises 


i 


(to be practiced by the reader) 


complete description of the situati 
in Table 3-1. 


Ove guidelines for the 


[Our effecti ication of ex 
tinction. However, do not try your rte 


plan at this time. 


EXTENDED DISCUSSION AND NOTES 
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(Continued) 

program or its rationale. This obsta ; 

earliest reports on the application Ue NAE RED a in one of the 
trums. Williams (1959) reported the case of a twen child's temper tan- 
fant who screamed and cried if his parents left FAERIT S iA 
ting him to bed at night. A program was initiated in Sea sitar (Slane 
left the room after bedtime pleasantries and did not ae ich the parent 
ter how much the infant screamed and raged. The M sd ss tie uncle 
was put to bed under this extinction procedure, he EONS the child 
five minutes. By the tenth night, however, he no longer E ORERE 
smiled, as the parent left the room. But about a week later, but rather 
parents were enjoying a much needed evening out, he er, when the 
fussed after his aunt, the baby sitter, had put him to bed UEM and 
forced the behavior by returning to the bedroom and anes SUN Tats 
until he went to sleep. It was then necessary to extinguish ES ingre 
a second time, which took almost as long as the first time e behavior 
: Ayllon and Michael (1959) observed the bad effect of un 
inforcement in extinction, which they called "bootleg ISO En 
A patient in à mental hospital engaged in such annoying ps RETE 
(of the type referred to as delusional) that other patients NE SUMA 
occasions beaten her in an effort to keep her quiet. To de n several 
psychotic talk, doctors instructed the nurses not to attend ir her 
attend only to sensible talk. As a result, the proportion of her ES it but to 
was psychotic decreased from 0.91 to 0.25. But later it deber xe 
level, probably because of bootleg reinforcement from a social Mone 
This reinforcement came to light when the patient remarked t worker. 
the nurses, “Well you're not listening to me. I'll have to go and Senel 
——-— (the social worker) again, cause she told me that if she ea 


to my past she could help me.” 

Kazdin and Polster (1973) demonstrated the extrem i 
intermittently reinforced behavior in an applied A d of 
breaks in a sheltered workshop, two retarded men who engdged th e 
social interactions received tokens for talking to peers. At first, eve ae 
teraction was reinforced, and the daily average number of GEGEN SA 
generally increased. Then extinction was applied, and the behavio feu 
idly decreased. Next, reinforcement was reinstated. One man nC 
ceived tokens for every interaction, but the other man was placed on ee 
intermittent schedule, which was thinned gradually until, after thes 
weeks, he received reinforcement at only one of the three daily CERA 
Then, extinction was again carried out for both men. The man who el 
been on continuous reinforcement again showed a rapid decrease in 
social interactions. But the man who had been on an intermittent-rein- 
forcement schedule maintained a high rate of interaction over a five- 


week period. 


Not infrequently, one meets the objecti 


ment to someone for “doing what he oug 
right bribery.” In a verbal exchange with a teacher, Roger Ulrich (1970, 


p. 337) handled this criticism quite well. First, he suggested that the 
teacher look up “bribery” in the dictionary. Complying, the teacher 
said, "Okay. the dictionary says that bribe means 'any gift or emolu- 
ment, used corruptly to influence public or official action, anything that 
seduces or allures, an allurement. Also any valuable consideration given 
or promised for corrupt behavior in the performance of official or pub- 
lic duties.’ " Ulrich then remarked, "It's quite common for people to re- 


on that presenting reinforce- 
ht to do anyway" is “down- 


(Continued) 
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fer to reinforcement as bribing, especially when we use it for children. 
According to the dictionary definition, however, it doesn’t seem to fit. It 
wouldn't seem that our efforts to get Billy to write his numbers better is 
really an example of trying to get him to do something illegal or some- 
thing which goes against what is generally looked upon as being ac- 
ceptable by our culture. Besides, Billy isn’t a public official. Actually, 
writing numbers seems to be a good thing to be able to do and when 
you do good things, you often get rewarded for them." 

Related to the bribery criticism is the frequently voiced criticism 
that extrinsic reinforcement for a behavior that a person finds (or 
should find) intrinsically reinforcing will undermine his motivation to 
engage in that behavior when the extrinsic reinforcement is no longer 


in (1975, pp. 50-52) con- 
cular behaviors in a given 
ose behaviors in other situ- 
75) provided additional evi- 
second-grade children were 

a follow-the-dots book. The 
number of dots each child connected was recorded over several daily 
fifteen-minute sessions. The number of dots was large for each child, 


] i as given for this behavior. 
Then, reinforcement in the form of points 


than previous ones and lasted 
one tantrum occurred; it last 


utes. The next day, only 
no further tantrums. 


ed fifteen minutes. After that, there were 


reinforced lever press. Thi 
sively with humans, in pa 
deliberately creating si 
such aggression. 


Study Questions on Notes 


1. How are extincti i imi 
ae xtinction and forgetting similar, and how are they differ- 


2. What is “bootleg reinforcement"? Give an example. 
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CHAPTER 4 
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Getting 
A New Behavior 


to Occur: 
an Application 


of SHAPING 


“Valerie, walk by yourself to supper" 


TEACHING VALERIE TO WALK 


A procedure to teach Va 
was devised. 


59 occur so that it could be reinforced, it was necessary to reinforce 
Shaping some other behavior first. 

2. Identifying a response that could be used as a starting point in 
working towards the final desired behavior. Valerie would some- 
times stand up and move from one chair to another (if the two 
chairs were very close together, about a foot or two apart, and if 
she was reinforced with food for doing this). The staff decided 
that this was a good response to begin with, since it was related 
to the desired behavior of walking to the dining room, in the sense 
that Valerie moved herself from one location to another. 

3. Reinforcing the starting response; then requiring closer and 
closer approximations until eventually the desired response oc- 
curred. First, the response of moving two feet, from one chair to 
another, was reinforced with food. This distance was gradually, 
increased until, finally, Valerie would walk the entire distance 


from the TV room to the dining room. 


At mealtimes, Valerie's food was placed on a table beside the sofa, 
behind which (as described in Chapter 3) Valerie was seated ona chair. 
The sofa was moved far enough back from the wall so that Valerie could 
walk from her chair to the chair next to the table on which the meal was 
located. Valerie was then left in the TV room by herself. When the other 
children had finished their meal in the dining room, Valerie was again placed 

the chair behind the sofa, whether or not she had finished her meal. 
i As can be seen in Figure 4-1, over a period of several days the table 


er and farther away from the sofa. ' 
ju TS lenken to walk slightly farther each time, until the table 


was placed under the archway leading out of the TV room. At this point, 


: Follow-Up 
" the Behavior F 
gene. Ege Feb. 20/69) (July/69 — April/70) 
Ov. 


—— Table beside Stair 


—— Table across Room 


-— Table under archway 
-— Reinforcer Sampling 


~— Table beside Valerie 


e — 
s du. 12.4. 16 


Time (days) 


Frequency of Walking to 
Table and Eating Unaided 


Iking behavior. Each dot on the graph 


je's wa 
des iom erie walked unaided to a table to eat 


nts the number of times Val 
given day. 


FIGURE 4-1. Contr 


represe 
her meal on any 
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oiling the pump has gradually acquired a little rust. Each day, the 
boy probably applies the approximate amount of force he applied the 
previous day. When that force is no longer reinforced by the produc- 
tion of water, because of the addition of the small amount of rust that 
has made the pump handle more difficult to move, the boy would 
likely apply a little more force and find that it pays off. Over several 
months, the boy is gradually shaped to press very hard on the first 
trial, a terminal behavior quite different from the initial behavior of 
moving the pump handle very easily. 


FACTORS INFLUENCING THE EFFECTIVENESS OF SHAPING 


1. Specifying the final desired behavior 


The first step in shapin 
havior, which is often referr 
case, 


8 is to clearly identify the final desired be- 
ed to as the terminal behavior. In Valerie’s 
the final desired behavior was walking unaided from the TV 
room to the dining room at mealtimes when told to do so. With a 
definition as specific as this, there was very little possibility that dif- 
ferent staff members would develop different expectations regarding 
Valerie's performance. If different people working with the individ- 
ual expect different things, or if one Person is not consistent from 


: at behavior. The final desired behavior 
should be stated in such a way that all of the characteristics of the 
behavior (its frequency, topography, intensity, and so forth) are iden- 
tified. In addition, the c 


not to occur should be stated 
be necessary for consist 


2. Choosing a starting behavior 


Since the final desired behavior d 
cause it is necessa 


rminal behavior was "extended 
m to the dining room), it was de- 
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sirable to start with an approximation of walking — namely, standing 


up and taking a step or two. 
In a shaping program, it is crucial to know not only where you 


are going (the terminal behavior) but also the level at which the indi- 
vidual is performing at the present time. The purpose of the shaping 
program is to get the two together, by reinforcing successive approxi- 
mations from the starting point to the final desired behavior, even 
though the starting point might be completely dissimilar to the ter- 


minal behavior.? 


3. Choosing the shaping steps 


program, it is helpful to outline the 


successive approximations through which the person will be moved 
in the attempt to approximate the final desired behavior. For ex- 
ample, suppose the final desired behavior is to teach a child to say 
"daddy." It has been determined that the child says "daa," and this 
response is set as the starting behavior. Let us suppose that we de- 
cide to go from the initial behavior of “daaa” through the following 
" "dad," "dad-ee," and "daddy." To begin with, the 
d on a number of occasions for emitting the initial 
behavior ("daa"). When this behavior is occurring repetitiously, the 
trainer moves on to step 2 (“da-da”) and reinforces that approximation 
for several trials. This step-by-step procedure continues until the child 


finally says “daddy.” 
We are sure SO 


Before initiating the shaping 


steps: "da-da, 
child is reinforce 


me critical questions have already occurred to 
you. What is a reasonable step size? How many trials at each step 
should one reinforce before proceeding to the next step? Unfortu- 
nately there is no set of guidelines for identifying the ideal step size. 
In attempting to specify the behavioral steps from the initial behavior 
to the terminal behavior, the teacher might imagine what steps she 
herself would go through. Also, it is sometimes helpful to observe 
students who can already emit the terminal behavior, and to ask 
them to emit the initial and subsequent approximations. Whatever 
guidelines or estimates are used, it is important to try to stick to 
them and yet be flexible if the trainee does not proceed quickly 
enough or is learning more quickly than had been expected. Some 
guidelines for moving through the behavioral program are offered in 


the following paragraphs. 


4. Moving along at the correct pace 


les of thumb to follow in reinforcing succes- 


There are several ru 
final desired response: 


sive approximations ofa 
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a) Do not move too soon (that is, after too few trials) from one approxima- 


tion to the next. Trying to go to a new step before the previous approxi- 
mation has been well established can result in losing the previous ap- 


proximation through extinction without achieving the new 
approximation. 
b) Proceed in sufficiently small steps. Otherwise, 


tion will be lost through extinction before th 
been achieved. 


the previous approxima- 
e present approximation has 


€) If you lose a behavior because you are moving too fast or t 
à step, return to an earlier approximation where you can 
havior again. (This almost happened in the case of te 
walk. Recall that when the table with food on it w 
archway, Valerie missed six meals in 
ressed a little too fast and should hav 
tion. Instead, they gambled that the 
bring about the next approximation. 
but it might not have, and the st 
havior they had established so P 


d) Items (a) and (b) caution against going too fast, and item (c) states how to 
correct for the bad effects of Boing too fast. It is also important not to 
Progress too slowly. If one approximation is reinforced for so long that it 
becomes extremely strong, new approximations are less likely to appear. 


aking too large 
pick up the be- 
aching Valerie to 
as placed under the 
a row, Perhaps the staff had prog- 
€ reverted to an earlier approxima- 
use of reinforcer sampling would 
Fortunately, the gamble paid off— 


aff might have lost a good deal of the be- 
ainstakingly.) 


These guidelines may not seem very helpful. On the one hand, 


it is advisable not to move too fast from one approximation to an- 
other, and on the other hand, it is advisable not to move too slowly: 
If we could accompany these guidelines with a mathematical formula 
for calculating the exact size of the steps that should be taken in any 
situation and exactly how many reinforcements should be given at 
each step, the guidelines would be much more useful.’ Unfortunately, 
T providing this information have not 
her must observe the behavior carefully 
hanges in the procedure— changing the 
ding Up, or retracing steps — whenever the 
be developing Properly. Shaping requires 
skill if it is to be Performed with maxi- 
mum effectiveness. 


PITFALLS OF SHAPING: HOW IT WORKS TO THE 
DISADVANTAGE OF THOSE 


WHO ARE IGNORANT OF IT 


aping, one that is commonly ob- 
leads to self-destructive behavior. 
ause of an unusual and unfortunate 
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tion of shaping. 


FIGURE 4-2. A misapplica 
all child receives very little social attention when 
ate behavior. Perhaps one day the child accidentally 
head lightly against a hard floor. Even if the child 
an overly solicitous parent may come run- 
over the incident. Because of this 


family situation, a 5m 


he emits appropri 
falls and strikes his 


is not injured seriously, 
ig fuss 


ning quickly and make a b 
reinforcement, and because anything else the child does seldom 
he is likely to repeat the response of striking his 


evokes attention, 


head lightly against t 
ent may continue to r 
seeing that the child is not really 
stop reinforcing it. Since the behavior has now been placed on ex- 
hild may increase the intensity of the behavior in an at- 

i ild may begin to hit his 


tinction, the c 
tempt to regain the reinforcer. 
^thud" will cause the 


head more forcefully, and the slightly louder 


he floor. The first few times this occurs, the par- 
einforce the response. Eventually, however 
hurting himself, the parent may 
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parent to come running again. If this shaping process continues, the 
child will eventually hit his head with sufficient force to cause physi- 
cal injury. It is extremely difficult, if not impossible, to use extinction 
to eliminate such violently self-destructive behavior. It would have 
been best never to have let the behavior develop to the point where 


the child’s parents were forced to continue reinforcing it and increas- 
ing its strength. 


Sometimes, extinction can be 


settings. For example, the 
could be placed in a pad- 
harmlessly against the soft 


the new behavior of non- 
room) in which the old be 
not reinforced) 


head banging from a situation (the padded 
havior of head banging was weak (i.e., was 
to a situation (another room) in which the old behav- 
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Another kind of pitfall is the unknowing failure of a person to 
apply shaping when it should be applied. Some parents, for example, 
are simply not very responsive to their child’s babbling behavior. 
Perhaps they expect too much from the child right from the begin- 
ning, and are not inclined to reinforce extremely remote approxima- 
tions of normal speech. (Some parents, for example, seem to expect 
their tiny new genius to say "Father!" right off the bat, and are not at 
all impressed when the child says "da-da.") Or perhaps their per- 
sonal problems interfere with their devoting the necessary attention 
to the child. On the other hand, some parents give their children 
plenty of reinforcement for the wrong things. Perhaps they are so 
overly concerned about the child's well-being that they provide her 
with all kinds of reinforcement without ever having to say or do any- 
thing for it. For example, they may continue to reinforce remote ap- 
proximations of speech without ever demanding closer approxima- 
tions. In other words, although shaping is a process that most 
a more or less desirable fashion, without realizing it, 
there are some parents for whom this is not true. 

Thus, there are many variables that can prevent a physically 
normal child from receiving the shaping that is necessary to establish 
normal speech behavior. If a child has not learned to talk by a certain 
age, he or she may be labeled as retarded or autistic. No one knows 
how many so-called mentally deficient individuals are in institutions 
not because of any genetic or physical defects, but simply because 
they were never exposed to effective shaping procedures. This num- 
ber could be quite large, for 80 percent of the individuals diagnosed 
as mentally retarded “have no verifiable or noticeable organic-genetic 
impairment" (Braginsky and Braginsky, 1971, P. 19). 

Regardless of the causes of a child's failure to talk, much 
progress can usually be made by the use of a shaping procedure. We 
shall defer a detailed description of developing verbal behavior until 
other principles applicable to the development of normal verbal be- 
havior have been discussed (see Chapters 7, 8, and 10). 


parents apply in 


GUIDELINES FOR THE EFFECTIVE 
APPLICATION OF SHAPING 


1. Select the terminal behavior a 

ific behavior (such a $ 

3 buco) Ter than a general category of behavior (for example, 

“good” classroom behavior). Shaping is appropriate for changing qual- 

di accuracy. quantity, and timing, as well as for developing new be- 
havior of a different topography (form). 

elect a behavior that will come und 


fter it has been shaped. 


s working quietly at a desk for ten 


er the control of natural 


b) If possible, s 
reinforcers a 


68 2. Select an appropriate reinforcer 


Basic See Figure 2-2 and p. 32. 

Behavioral 3. The initial plan En 
Principles a) List successive approximations of the terminal behavior, beginning 
and Procedures 


b) 


with the initial behavior. To choose the initial behavior, find a a eed 
ior already in the student's repertoire that resembles the termina be 
havior most closely and that occurs at least once during an observation 
period. If your terminal behavior is a complex sequence of d 
(such as making a bed) that you have broken down into — 
steps, and if your program amounts to linking the steps together in a 
particular order, then your program is not best described as Shaping, 
nor is it best developed through a Shaping program. Rather, it should 
be developed by chaining (see Chapter 10). 

Your initial steps or successive approximations are usu 
guesses." During your program, 
student's performance. 


ally "educated 
you can modify these according to the 


4. Implementing the plan 


a) 
b) 


c) 


d) 


e 


Study Questions 


Tell the student about the plan before starting. 


Begin reinforcing immediately following e 


‘ach occurrence of the starting 
behavior. 


Never move to a new approximation until the student has mastered 
the previous approximation. 


Ove the student to a new approximation, 
humb: Move to the next step when the 
step correctly in six out of 10 trials (usu- 
5 perfect than desired and one or two tri- 


ter than the current step). 
Don't reinforce too many times at any one step, and avoid under- 
reinforcement at any one step. 


you have moved up the steps too quickly, 
the steps are not the right s 


ize, or the reinforcer is ineffective: 
(1) First, check the effectiveness of your reinforcer, 


n you have progressed too 


rapidly. If so, return to the previous step for a few more trials and 


then try the present Step again. 
(4) If the student continues to have difficulty, despite ” 


€ retraining” at 
previous steps, add more steps at the point of difficulty, 


(for examination Purposes) 


1 


case of Valerie or an example 


Identify the three basic ste 
the start of this cha er, 


Ps in any shaping Procedure, as presented at 
d 


describe them with an example (either the 
of your own), 


pt 
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Explain how shaping involves successi icati 
lai essive appl inci 
positive reinforcement and extinction. a niki wikis 
3. What is another name for shaping? 
4. Outline, according to the three st i i 
e, eps in a shaping proced 

ents might shape their child to say a port rey PARARE 

5. What one word characterizes all of the vari 
| a variables plotted o; i 

axis of all the graphs in the book thus far? j eae 
6. What do we mean by the topography of a response? Give an example 
7. What do behavior modifiers mean when k i i 

oe they talk about the "terminal 
8. Why bother with shaping? Why not just learn about the use of straight- 
forward positive reinforcement to increase a behavior? $ 


9. Define shaping. 
What factors influence the selection of the successive approximations or 


N 


10. 
steps between the initial starting behavior and the terminal behavior? 
Discuss an example. i 

11. How do you know you have enough successive approximations? 

12. How do you know if you are allowing enough reinforced trials to occur 
at each of the approximations? 

13. Describe an example of how shaping might be accidentally used to de- 
velop an undesirable behavior. 

14. Describe an example of how the failure to apply shaping might have an 


undesirable result. 
15. What are two difficulties in trying to eliminate an undesirable behavior 


by extinguishing that behavior and applying positive reinforcement for a 
desirable alternative behavior? (See p. 66.) Give an example from your 


own experience. 


16. Give an example fr 
might best be developed through a pr 


p. 68.) 
17. Why is it necessary to avoid reinforcing too many times at any step? 


18. Why is it necessary to avoid underreinforcement at any step? 
19. How is the procedure of shaping similar to the principle of positive rein- 
forcement? How is it different? 


20. Why do we refer to positive rein 
and to shaping as a procedure? 


om your own experience of a terminal behavior that 
ocedure other than shaping. (See 


forcement and extinction as principles, 


Study Exercise 


(to be practiced by the reader) 


Think of a normal child between the ages of two and seven with whom you 
have had contact (for example, a sister, brother, or neighbor). Specify a real- 
istic behavior that you might try to develop by utilizing a shaping proce- 
dure. Outline the starting point you would choose and the successive ap- 
proximations you would go through. 


Self-Modification Exercises 
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(to be practiced by the reader) 


1. Take a close look at many of your own behaviors — for example, sporting 
skills, personal-interaction skills, love-making skills, and study-skills. 
Identify at least five specific behaviors of yours that were probably 
shaped by others, either knowingly or unknowingly. Identify at least five 
specific behaviors that were probably shaped by the natural environment. 
Put each of your examples in sentence form, approximately as follows: “I 
was probably shaped to hit a ping-pong ball with a good chop stroke. 
That is, after learning basic ping-pong skills, each time I tried a bit of a 
chop, the ball would fly off the table. Eventually, a slight chop was rein- 
forced by the ball landing on the table and the other person hitting the 
ball into the net. As the other Person learned to return my chops, I was 
reinforced for putting slightly increasing amounts of chop on the ball. In 
all cases, the reinforcement was returning the ball to the other side of the 
table and even greater reinforcement was returning it to the other side of 
the table such that the other person missed.” 

2. Select one of your behavioral deficiencies that you listed at the end of 
Chapter 1. Outline a complete shaping Program that you (with a little 
help from your friends) might use to overcome that deficiency. Make sure 


that your plan follows the above Buidelines for the effective application of 
shaping. However, do not try your plan at this time. 


followed immediately by a certain con- 

d beige eu psnense is more probable when the individual 
4 uation. This impli e 

should be maximally probable i e REO JE en 
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(Continued) 
methods in the treatment of diseases such as high blo 
problem that has been detected by research Butta ee Oe s 
in the modification of heart rate, however, is that the changes obtained 
are typically in the range of only one to six beats per minute, which i 
of very little or no therapeutic value. ij i 
A study by Scott, Peters, Gillespie, Blanchard, Edm 
Young (1973) indicated that shaping may be important in Elgin 
this problem. Three individuals participated in the study—two normal 
male college students and a psychiatric patient suffering from chronic 
anxiety and manifesting a moderately elevated heart rate. During daily 
twenty-minute experimental sessions (each of which was preceded by a 
twenty-minute "adaptation" period), each man sat in a chair and 
watched television while his heart rate was recorded. After determining 
each man's baseline heart rate when he was watching television over a 
number of sessions, the experimenters wired the equipment in such a 
fashion that the sound portion of the television program would be on 
continuously but the video portion would be on only when the individ- 
ive beats per minute above the baseline rate (for 


ual's heart rate was five 
each of the college students) or five beats per minute below the base- 


line rate (for the psychiatric patient). (One of the college students was 


also reinforced with one cent for every ten seconds that his heart rate 
he had complained about the standard 


was at the specified level, since 

television fare with which he was being presented.) This was shaping 

step 1. When the individual's heart rate remained at the designated high 
ions, the difference between the 


or low level for three consecutive sessi 
baseline level and the level required for reinforcement was increased by 
five beats per minute. This was shaping step 2. Shaping step 3 con- 


sisted of again increasing the requirement by five beats per minute, af- 
ter the successful completion of shaping step 2. The outcome of the 
shaping procedure Was that the heart rate of one of the college stu- 
dents was accelerated to an average of seventeen beats per minute 
above baseline, that of the other college student was accelerated to an 
average of sixteen beats per minute above baseline, and the heart rate 


hiatric patient was decelerated to an average of sixteen 
| e next phase of the study, 


out having to behave in any specific manner. The heart rates of the two 
college i ed to baseline levels. That of the psychi- 
atric patient, however, remained at the low level to which it had been 
shaped. To demonstrate t cedure was responsible for 

rimenters then used the 


i an's decrease in h e im 
tnis heart rate back to its original level. Interestingly, 


rocedure to shape his ; j 
the experimenters noted that during the period that this patient's heart 
rate was decelerated, reports from his ward indicated that “he seemed 
less ‘tense’ and ‘anxious’ " and that “he made fewer requests for medi- 


cation... V 

For example, in a classic study, Isaacs, Thomas, and Goldiamond 
(1960) used shaping to redevelop verbal behavior in a catatonic schizo- 
phrenic who had been mute for nineteen years prior to training. Using 
chewing gum as a reinforcer, the experimenter shaped the patient 
through the behaviors of eye movement towards the gum, facial move- 
ment, mouth movements, lip movements, vocalizations, word utterance, 
and, finally; verbal behavior. 


In some situations, one's choice of step size might be influenced by 


(Continued) 
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the type of recording apparatus available. Jackson and Wallace (1974) 
shaped voice loudness in a fifteen-year-old giri (Alice) who was diag- 
nosed as “‘severely disturbed, withdrawn, and mildly retarded." A major 
problem was that Alice rarely spoke; when she did, her speech was 
barely audible (a disorder called aphonia). Jackson and Wallace con- 
ducted training sessions that incorporated a voice-operated relay wired 
to a token dispenser. Alice was shown the tokens and instructed that 
she could cash them in for books, beauty aids, and a photo album, 


among other things. However, in order to earn tokens, she had to speak 


into the voice-operated relay loudly enough to trigger the dispenser. 


Initially, the relay was set for maximum sensitivity so that very soft 
speech by Alice would produce tokens. When 80 percent of Alice’s re- 
sponses were loud enough to produce tokens, the dial on the voice-op- 
erated relay was changed by one unit, such that slightly louder speech 
was required. When Alice again performed at the 80-percent level, the 
sensitivity of the relay was altered by another unit. In this way, Alice’s 
voice loudness was successfully shaped through eleven steps. 


Study Questions on Notes 


1. What is reinforcer sampling? 

2. Describe an example of reinforcer sam 
fied as such) that you read about on p. 18 

3. What is biofeedback? Wh 


4. Describe how Scott et al. used shaping to markedly decrease the 
heart rate of a man Suffering f 


rom chronic anxiety and manifesting a 
moderately elevated heart rate. 


pling (which was not identi- 


y is it important to study it? 


uals, how did Scott et al. d 


6. What did Isaacs, Thomas, and Goldiamond do? 
7. Your choice of step size in a 


shaping program might be influenced 
by your apparatus. Briefly describe an example of this, 


CHAPTER 5 SECTION ONE 
Developing 


Behavioral Persistence 


Through the Use of 
INTERMITTENT 
REINFORCEMENT 


| “Benny, you must learn to be patient” 


SOME PATIENCE FOR BENNY 


retarded boy, could not wait for various 
* Just before meals, juice-and-cookie 


times, for example, he would run to the nurses and 
ties. After a while, the nurses found this rather 


disrupting. Consequently they decided to teach Benny to sit quietly out- 
side their office door until they came out to initiate the scheduled activity. 

Besides being impatient to start activities, Benny loved candy. In de- 
veloping patient behavior in Benny, the nurses therefore decided to use 
candy and the activities themselves as reinforcers. The procedure was as 


year-old severely 


Benny, an eleven- 
ities to begin. 


enjoyable ward activ 
periods, and visiting 
beg them to start the activi 


of Rehabilitation Medi- 


Lynn Caldwell, Department 
ails of Benny’s case. 


nowledge Dr. 
providing us with the det 


*We gratefully ack 
f Washington, for 
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follows. First, the staff bought a big bag of candy and made sure that 
Benny had no access to any other candy on the ward. Second, they pur- 
chased a kitchen timer—the kind that goes "Ding!" at the end of a set 
time period from zero to ten minutes. Third, they put a chair just outside 
the office door half an hour before each activity was to begin. Fourth, they 
gave Benny the following instructions: "Benny, from now on we are going 
to play a game with you. Whenever you come to the office to tell us to 
start some activity we will set the timer, and when it goes ‘Ding!’ we will 
look to see where you are. If you are sitting on the chair, then we will give 
you a candy and let you be first [i.e., the first to participate in the activity]. 
But if you are not sitting on the chair when the timer goes 'Ding! then you 
will not get a candy and you will miss the activity." Benny was given the 
above instructions one morning after the nurses' coffee break. (How well 
he understood these instructions is not clear. Nevertheless, he was able to 
follow some simple instructions, and this was helpful in establishing the 
desired behavior— although, like the procedures described in the previous 
chapters, the present procedure might have worked even had he not un- 
derstood any instructions at all.) Shortly before lunchtime the same day. 
Benny came running to the office on his regular mission of pestering. 
Armed with the timer, one of the nurses met him and said, "Benny, sit on 
the chair." The timer, which was set for a very short period, went "Ding!" 
almost as soon as Benny was seated. Immediately, all the nurses rushed 
out of the office and praised him, and one nurse gave him a candy. More- 
over, they told him that he would be the first to line up for lunch. This 


ditional half-hour periods that day. 
à different value, which varied from 
Dy never knew when the "Ding! 
hort, or intermediate interval. 

there were twelve trials, Benny was 
hen the "Ding!" occurred. On each 
candy and was not allowed to par- 


INTERMITTENT REINFORCEMENT 


The term intermittent reir 
havior by reinforcing it 


pit intermittently) rather 
than every time it Occur: 


ior, for example, was 
the chair. Instead, it 
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To talk about intermittent reinforcement, we must first defin 
schedule of reinforcement. A schedule of reinforcement is a rule s nd 
fying which occurrences of a given behavior, if any, will be eei 
forced. One of the two simplest schedules of reinforcement is contin- 
einforcement. Had Benny received reinforcement each time he 
or had he received reinforcement throughout 
the entire period he was on the chair, we would say that he was on a 
continuous-reinforcement schedule.' This schedule was incorporated 
in several of the cases discussed in prior chapters. For example 
Charles (Chapter 2) was on a continuous reinforcement schedule for 
taking his pills, because he received a puff on a cigarette each time 


he swallowed a pill. 
The second of the two simplest schedules of reinforcement is 


the opposite of continuous reinforcement. It is called extinction. As 
we have seen in Chapter 3, on an extinction schedule no instance of 
a given behavior is reinforced. The effect is that the behavior even- 
tually decreases to a very low level, or disappears altogether. 

Between these two extremes — continuous reinforcement and ex- 
tinction—lies intermittent reinforcement: one may reinforce certain 
instances of the given behavior while allowing other instances to go 
unreinforced. Any rule specifying a procedure for doing this is called 
an intermittent-reinforcement schedule. There are an unlimited num- 
ber of such schedules. Since each produces its own characteristic be- 
havior pattern, the different schedules are suitable for different types 
of applications.” In this chapter, we will limit our discussion to sched- 
ules that (1) appear to be the most useful for increasing and main- 
taining behavior in various training programs or (2) are useful for 
interpreting the influence of schedules of reinforcement in daily 
life. We will illustrate these schedules with examples from everyday 
life (see, for instance, Figure 5-1), where most behavior is reinforced 
intermittently (although seldom as a result of well-planned design). 
In addition, we will examine various uses of the schedules in train- 
ing programs. Specific reference will be made throughout to Benny’s 
case. In the remainder of Chapter 5, we will discuss eight schedules: 
fixed-ratio, variable-ratio, fixed-interval, fixed-interval-with-limited 
hold, variable-interval, variable interval-with-limited-hold, fixed- 


i —À 1 
duration, and variable-duration. 


uous Y 
sat down on the chair, 


1. The Fixed-Ratio Schedule 


On a fixed-ratio (FR) schedule, reinforcement occurs each time a 
set number of responses ofa particular type are emitted. If ten re- 
e required per reinforcement, We call the schedule an 
dule; if twenty are required, we call it an FR 20 schedule; 


sponses ar 
example of an FR schedule is paying an in- 


FR 10 sche 
and so on. One common 
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ERE AM Se. money for a specified number of 
E id o must do a specified number of 
problems or read a specified number of pages to complete a h : 
work assignment is also performing under this type of pret a 2 
Provided that the amount of behavior required for reint 
ment has been increased fairly gradually, the characteristic dedol 
an FR schedule is a high rate of responding followed by a pause 55 
period of no responding) after each reinforcement and before the 
son starts working toward the next reinforcement. ES 
The length of this pause depends on the amount of behavior re- 
quired per reinforcement. If too much responding is required, or if 
the amount of responding required is increased too zapidly the 
e will be so long that little or no responding will occur. (This 
led ratio strain.) There are several rea- 
her than continuous reinforcement in 


paus 

breakdown in responding is cal 

sons for using FR schedules rat 

applied training programs: 

1. FR generates higher rates of responding than continuous reinforcement (at 
less time is spent administering reinforcement). 


least partly because 
2. The reinforcer remains effective longer on FR than on continuous rein- 
forcement (because satiation takes place more gradually). 


3. Behavior takes longer to extinguish after it has been reinforced on FR than 


after it has been continuously reinforced. 
4. Training on FR helps prepare the behavior for being maintained by the 
intermittent-reinforcement schedules that often exist outside the training 
situation for that same behavior, or a similar one; in other words, training 


on FR teaches “persistence.” 


made use of FR schedules in a task designed to teach 
picture names to retarded children. In this task, each time the child 
attended to the teacher (for example, by looking at him), the teacher 
presented a picture to the child. According to a carefully designed se- 
quence, the teacher sometimes spoke the name of the picture for the 
child to imitate and sometimes required that the child correctly name 
the picture. Each correct response was reinforced by the teacher say- 
ing "Good!" Correct responses were also reinforced with small, 
sugar-coated chocolate candies (M&Ms or Smarties), but we have 
since found that it is better not to reinforce every correct response 
with a candy (Stephens, Pear, Wray, and Jackson, 1975). Children at- 
tend at higher rates, make more correct responses, and learn to name 
more pictures when correct V on and picture-naming re- 


ocal-imitati 
sponses are reinforced on an FR schedule than when they are contin- 
uously reinforced. This is true, 


however, only if the FR schedule does 
not require too many correct responses per reinforcement. As the re- 
sponse requirement increases, performance improves at first but then 


begins to show ratio strain. The optimal response requirement differs 
for different children. In general, it must be found by trial and error. 


We have 
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Although FR is the appropriate schedule for some behaviors, " 
is not appropriate for others. Suppose that Benny had received rein 
forcement on an FR 10 schedule. That is, suppose that he received re- 
inforcement after each tenth time he sat down on the chair. This 
would have produced a high rate of sitting down, standing up, es 
ting down, and so on, until he obtained reinforcement. Obvious y 
this was not the behavior pattern the staff wanted in this particular 
case. Thus, they did not choose this schedule for Benny. 


2. The Variable-Ratio Schedule 


A variable-ratio (VR) schedule is like an FR schedule except that 
the number of responses required to produce reinforcement changes 
unpredictably from one reinforcement to the next. The number of ie 
sponses required varies around some mean value. For example, if the 
mean value is twenty-five, then fifteen responses may be required to 
produce the first reinforcement, fifty to produce the second, thirty to 
produce the third, five to produce the fourth, and so on. If an average 
of fifteen responses are required for reinforcement, we call the sched- 
ule a VR 15 Schedule; if an average of twenty-five are required, WE 
call ita VR 25 schedule, and so on. 

The natural environment cont 
VR schedules. The one cited most 
Slot machines and other 


ains many common examples of 
often is the “one-armed bandit. 

gambling devices are programmed according 
at gamblers have no way of predicting no 
how many coins they pes 
(by hitting the jackpot), 2 : 
they will lose money ove 


dvantage of the person being reinforced. 


Frequently, however, it is advantageous to be hooked on a VR 


Schedule. Even after repeat 
fisherman continues casting i 


amount of material just to 
teresting, or useful. A fin 
should reflect the commo 
life. A door-to-door sales 
is working on a VR 10 
he will make a sale, 


get to the parts she finds entertaining, in^ 
al example from the natural environment 
n occurrence of VR schedules in everyday 
man who averages one sale every ten houses 
schedule. He can never predict exactly when 
although he probably knows that his success rate 
metimes he makes two or more sales in a row. At 


other times, he may have to call at twenty or more homes before he 
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makes a sale. Such individuals, as we all know, tend to be very 
, per- 


sistent. 
Provided that the average amount of behavior required per rei 
ein- 


forcement has been increased fairly gradually, the characteristi 

of VR is a high rate of responding.’ In this respect it PI 
Moreover, if the amount of responding required per in E im 
too large, or if it is increased too rapidly, there will be little or EN M 
VR has the same advantages over continuous icri 
programs that FR does (see p. 77). In addi- 


dvantages over FR: 


sponding. 
ment in applied training 
tion, VR has at least two a 


1. On VR, unlike FR, there is typically little or no pausing after reinforce 


ment. 
The amount of behavior required pe 
greater extent on VR than on FR, wit! 


r reinforcement can be increased to a 
hout deterioration of the behavior. 


N 


R is often used when these advantages are not 
impler to administer. 

Benny for the same reason that FR was 
rated a high rate of sitting down, stand- 
hich was not the behavior pattern de- 


Nevertheless, F 
too important, because it is S 

VR was not used with 
not used: it would have gene: 
ing up, sitting down, etc., W 
sired in that particular case. 


3. The Fixed-Interval Schedule 


e first instance of a particu- 


Ona fixed-interval (FI) schedule, th 
(measured from some event 


lar behavior after a fixed period of time 
such as the previous reinforcement or the beginning of a trial) is re- 


inforced. All that is required for reinforcement to occur is that the in- 
dividual engage in the behavior after the reinforcement has become 
available due to the passage of time. If one minute must elapse be- 
fore the behavior can be reinforced, we call the schedule an FI 1- 


minute schedule, and so on. 
To avoid confusion, note t 


the passage of time is not sufficie 
reinforcer is contingent upon the first instance of the behavior that 


occurs anytime after the passage of a specified interval. Second, a re- 
sponse occurring before the specified interval is up has absolutely no 


effect on when the reinforcer will oc 
A job that pays by the hour is S 


hese two features of FI: first, by itself 
nt for reinforcement to occur. The 


cur. 
ometimes cited as an example of 
an FI schedule, but this is not correct because hourly pay assumes 
that the individual works during the hour. An FI schedule, however, 
requires only one response at the end of an interval. If a person is 
paid weekly, his going to pick up his paycheck can be considered to 
approximate an FI schedule. It does not make any difference how 
many times he goes to pick it up before it is ready: if it’s not ready, 
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it’s not ready, and he will not get it any sooner if he spends all his 
free time at the pay window. However, at the appointed time when 
the check is ready or at any time thereafter, if he goes to the pay 
window, he will receive his monetary reinforcer. Strictly speaking, 
this example only approximates an FI schedule, because a worker has 
access to clocks and calendars that tell him exactly when his paycheck 
will be available. 

Provided that the length of the interval has been incre 
gradually, the characteristic effect of an FI schedule is 
steady responding just prior to reinforcement, followed by a pause 
immediately after reinforcement. The length of this pause depends on 
the length of the FI: the longer the interval, the longer the pause.? It 
also depends on the individual's “sense of timing," especially if this 
sense is facilitated by clocks or calendars. For example, the worker 
who is paid by the week is not likely to report for her paycheck a day 


or even an hour early, because she knows the exact date and time it is 
due. 


ased fairly 
relatively 


4. The Fixed-Interval-With-Limited-Hold Schedule 


nterval-with-limited- 


A fixed-i 
Schedule with a slight modification 


“set up,” its 
Period of time, as it is 
t is held for only a limited period 


"limited hold” i 
kaana old”). Suppose that a given behavior is re- 
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a limited time—perhaps two minut i u n 
me es. If the individual i h 
bus stop within this limited period of time, she misses airs ia 1 
us an 


must wait for the next one. 
Provided that the length of the FI portion of the schedule h 
as 


been increased gradually, the characteristic i 
steady responding and (2) much shorter un a "eb 
ment and before the person begins working toward the ee 
n with simple FI. If the interval is too large gad 
creased too rapidly, the behavior will decrease drastically ar will sd 
occur at all, especially if the limited-hold period is very short alie 

An FI/LH schedule could have been used with Benn E 
nurses decided against it, primarily because another bes niei id 
that is to be discussed below — offered further advantages. S Men 
that the nurses had used an FI 5-minute/LH 2-second PON e 
Benny. The boy would have been on the chair a good portion die 
five minutes, and the nurses would not have had to monitor his im 
havior continuously. However, he might still have bothered them fo 
the first several minutes or SO of the interval. Furthermore de 
schedule would not have taught Benny to sit on the chair ford à 
longer than a five-minute period on each occasion. I 

Because the material concerning schedules of reinforcement is 
quite complex, and because in this book we have tried to be con- 
sistent in applying the available information concerning schedules of 
reinforcement, we have decided to divide Chapter 5 into two sections 
(As described on pP. 77 and 79 excessively large FR's and VR's pro- 
duce ratio strain. Section Two of the chapter begins on p. 84.) 


forcement, tha 


Study Questions 


(for examination purposes) 


1. Describe briefly, point by point, how Benny was taught to sit and wait 
patiently. 

2. Define and give an example of each of the following: 
a) intermittent reinforcement 


b) schedule of reinforcement 
c) continuous reinforcement 


d) extinction 
3. What are the two simp 
4. Name the schedules of reinf 


lest schedules of reinforcement? 


orcement mentioned in Chapter 5, section one. 


82 

Basic 
Behavioral 
Principles 

and Procedures 


ALG. 


. Which schedule is most advanta 


- What is an FI schedule? What is its ch 
. Explain why simple FI Schedules ar 


- What is the characteristic 
- Describe what 


. Explain wh 


Explain what an FR schedule is. Give two examples of FR schedules in 
everyday life (at least one of which is not in the text). 
What is the characteristic effect of an FR schedule? 


Describe what happens if an FR schedule is too large, or if its size is in- 
creased too rapidly. 


What is ratio strain? 


Explain why FR was not used in teaching Benny to sit and wait pa- 


tiently. 


. Explain what a VR schedule is. Give two examples of VR schedules (at 


least one of which is not in the text) 


. Describe how a VR schedule is similar to an FR Schedule. Describe how 


it is different. 


. What is the characteristic effect of a VR schedule? 
. Describe what happens if a VR schedule is too | 


arge, or its size is in- 
creased too rapidly. 


geous in training programs—FR, VR, 


continuous reinforcement? Justify your selection. 


. State two advantages of VR over FRin training programs. 
. State two possible applications of VR in trai 
. Explain why VR was not use 


ning programs. 
d in teaching Benny to sit and wait pa- 
tiently. 


aracteristic effect? 


€ not often applied in training pro- 
grams. 


. Explain what an FI/LH Schedule is, 


and give two examples from every- 
day life (at least one of which is not in the text). (Hint: Think of behav- 
iors that occur at certain fixed times, such as arriving for meals, plane 
departures, and cooking.) 


- Describe how an FI/ 


S LH schedule is similar to a simple FI schedule. De- 
scribe how it differs. 


effect of an FI/LH schedule? 


. happens if the FI Portion of an FI/LH schedule is too 
large, or is increased too rapidly, 


y FI/LH was not used in teaching Benny to sit 


: and wait pa- 
tiently. 
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(Continued) 
search, duration is a more meaningful property than rate f 

cially significant behaviors dealt with in applied research (as je ie 
sented in, for example, the Journal of Applied Behavior sss It 
seems appropriate to regard continuous reinforcement of such Beha 
iors to mean, literally, continuous presentation of the Ee 


throughout the period in which the behavior occurs. 


The effects of different reinforcement schedules ha i 
extensively with animals—especially pigeons, rats, Meyer 
unfortunately, not very much with humans. The classic authoritative 
work on this topic was written by Ferster and Skinner (1957); it deals 
mainly with pigeon experiments. The research on schedules of rein 
forcement with humans that has been done, however, suggests that h A 
man behavior patterns generated by various reinforcement PARS 
are quite similar to those of other animals (see, for example, Lon F 
Hammock, May, and Campbell, 1958; Ellis, Barnett, and Pryer, 1960; on 
lander and Bijou, 1960). ‘ WERE 


For a very clear and comprehensive discussion of reinforcement 


schedules, see Reynolds (1975). 
Whelan, and Hopkins (1968) trained three withdrawn, 


Kale, Kaye, 
chronic schizophrenic patients to emit spontaneous greetings (e.g 
Hello, Mr. —— —!') by using cigarettes as reinforcers. The reinforce- 


ed from continuous reinforcement to 
: the response of greeting continued 
to occur at a high rate. Moreover, it continued to occur at a high rate 
even when cigarette reinforcement was discontinued completely (al- 
though it was perhaps being maintained by the social interaction it pro- 


duced). 

A recent analysis suggests this may be true even with intervals of 
several months duration. Weisberg and Waldrop (1972) examined the 
rate at which the U.S. Congress passed bills during legislative ses- 
sions from 1947 to 1968. This rate exhibited a fixed-interval pattern. It 

h three to four month interval after com- 


was extremely low during eac 
mencement, followed by an increase in the rate of bills passed until the 


time of adjournment. 


ment schedule was gradually thinn 
a high VR schedule. Nevertheless, 


Study Questions on Notes 


1. What would be the difference between à continuous-reinforcement 
schedule for a child's jumping and a continuous-reinforcement sched- 


ule for a child's sitting? 
2. Who wrote the classic authoritative work on schedules of reinforce- 


ment, and what is the title of their book? 
3. What potential natural reinforcement may have been 
Kale et al. experiment? 


4. The pattern of responding sho 
what schedule? Describe three o 


term control. 


involved in the 


U.S. congressmen is typical of 


wn by 
f your behaviors under similar long- 


CHAPTER 9 SECTION TWO 
More About Increasing and 


Maintaining Behavior 


Through the Use of 
INTERMITTENT 
REINFORCEMENT 


1. The Variable-Interval Schedule 


A variable-interval (VI) schedule is like an FI schedule except 
se before reinforcement becomes avail- 
rom one reinforcement to the next, in- 
nterval varies around some mean value. 


Y, we will not get through to 
him any faster no matter how many times we dial; (2) however, rein- 
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forcement (getting through) ma i i 

up and the line 3 no pida ia [pego rte ud DOE 
this will be (sometimes he has lengthy sepe predict how long 
times short ones), and, thus, we must kee cake E. 
through. DR) ee 

Provided that the average amount i i $ 

ity of reinforcement has ead lender eee 
teristic effect of VI is fairly uniform responding TH n iub ape 
give it an advantage over FI, which, as we already nee cem 5 
pause — the length of which depends on the length of ieu qe : 
lowing reinforcement. However, with VI, pausing is still oe T 
is spread more uniformly throughout the interval. Hence o d 
tage of VI may be more apparent than real. Partly lir dux ice 
simple VI, like simple FI, is not often used in training EE oe 
Benny's chair-sitting behavior been reinforced on VI, he it P 
would have been on the chair for only very short retta b: in : 
perhaps just long enough to see whether reinforcement had been Lum 
up” yet—and would likely have spent the rest of the time bue 


the nurses. 


2. The Variable-Interval-With-Limited-Hold Schedule 


A variable-interval-with-limited-hold (VI/LH) schedule is a 
simple VI schedule with the same kind of modification that trans- 
forms a simple FI schedule into an FI/LH schedule. With VI/LH, as 
with a simple VI schedule, the behavior is reinforced only if it occurs 
after a certain interval, which varies unpredictably from one rein- 
forcement to the next. However, in order to be reinforced, the behav- 
ior must also occur no later than a certain period of time following 
the availability of reinforcement. That is, once a reinforcement is set 

a limited period of time. If it is not 


s availability is held for only 
" and reinforcement 


up, it 
ited period, it is "lost 


obtained within that lim 
cannot be obtained until the end of the next interval. For example, 
suppose that a given behavior is reinforced on what is called VI 
5-minutes/LH 2-seconds. This means that the behavior is reinforced 
only when it occurs within two seconds after the end of intervals 
varying in duration around a mean of five minutes. 

s from the natural environment of 


There are many more example 
VI/LH schedules than there are of simple VI schedules. Telephoning 
given above as an example of a VI 


a friend whose line is busy, 
schedule, more accurately approximates a VI/LH schedule. The friend 
es his phone call, or he may receive 


may leave shortly after he finish 
another call. In each case, if we do not call during one of the limited 


periods in which the line is free and the friend is at home, we miss 
the reinforcement of talking to our friend and must wait another un- 
predictable period before we again have the opportunity to gain this 


reinforcement. 
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Watching television programs, movies, and sporting events are 
other examples of behavior reinforced on a VI/LH schedule. Occa- 
sionally, at rather unpredictable intervals, something reinforcing hap- 
pens and maintains our watching behavior. The limited-hold aspect 
is present in that the viewer will miss a reinforcer if he is not attend- 
ing when it occurs (although instant replays may alter this situation 
somewhat). Just as a compulsive gambler is “hooked” on VR, so the 
television addict is tightly controlled by VI/LH, in which reinforce- 
ment is not only unpredictable but also (for many programs) rather 
infrequent. As with other schedules (especially VR), VI/LH schedules 
may work to the disadvantage of people exposed to them 
student "wastes" too much time watching television whe 
be more productive by studying) The persistence developed by 
VI/LH can also be desirable, however. The patience of a fisherman 


hanging a line in the water is rewarded on VI/LH, because schools of 
fish swim near his bait at varying intervals. 


8th of the VI portion of the sched- 
the characteristic effect of VI/LH is 
pausing. In this respect, it has an 
ically produces pauses before the 
he next reinforcement. Moreover, 


(as when a 
n she could 


E to that schedule. However, with 
if the average length of the interval is too large 


or is increased too rapid] i i i 
a A s Y, the behavior will decrease drastically or 


ed especially if the limited-hold period is very 
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that opportunity for reinforcement. H imi 

VI/LH schedule is the length of time hora idis E 
d acher to look over 

Benny was reinforced on a VI/L j 

was a tiny fraction of a second. repeto dirae I E 
be on the chair at the exact moment the "Ding!" Hee ip eats 
nurse looked toward the chair. Since Benny could berets Ausra 
this would happen (because different times were used pone 
trials), he had to be on the chair almost continuously afte ü see 
nouncement of an activity in order to avoid missing seins nem 
Accordingly, this is what he did, even though he Hic Hear ee 
sit on the chair for as long as ten minutes before reinforcem Metis 
curred. Had the nurses wished to do so, they could have e dis 
increased the VI part of the schedule so that Benny would ye T 
sit for even longer periods. However, it would still have been ni s 
nclude some short and intermediate intervals; otherwise i 
enny would have learned that he could bother the E 
sing the opportunity to obtain re- 


to 
essary to i 
with FI), B 
for the first few minutes without lo: 


inforcement. 


3. The Fixed-Duration Schedule 


On a fixed-duration (FD) schedule, reinforcement occurs after 
the behavior has been engaged in for a certain continuous period of 
time. If ten continuous seconds of the behavior are required per rein- 
forcement we call the schedule an FD 10-second schedule; if twenty 
are required, we call it an FD 20-second schedule; and so on. 

Parents commonly use (or attempt to use) FD schedules: “Prac- 
tice the piano for an hour and then you can go out and play”; or, 
"Study your homework assignment for two hours and then you "t 

paid by the hour is also (presumably) 


watch TV." A worker who is 
he physical environment provides FD 


on an FD schedule. Sometimes t 
schedules. For example rubbing two sticks together rapidly for a cer- 


tain continuous period produces fire; directing a steady stream of 

water on the fire for a certain continuous period extinguishes it. An- 

other example is that to melt solder, one must hold the tip of the sol- 

dering iron on the solder for a continuous fixed period of time. If the 

tip is removed, the solder cools quickly and the person has to start 
he same continuous period. 


over again and apply heat fort 
t of behavior time required for rein- 


Provided that the amoun 
forcement has been increased fairly gradually, the characteristic effect 


of an FD schedule is that the behavior occurs continuously for long 
periods of time. As with FR schedules, however, a pause occurs im- 


mediately after reinforcement and before the person begins working 
inforcement. The length of this pause depends on 


toward the next rein 
the time requirement of the FD schedule: the longer the time require- 
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ment, the longer the pause. Moreover, if the time requirement is too 
large or is increased too rapidly, the behavior will decrease drastically 
or will not occur at all. (FD has not been studied as much as the 
schedules described above. Thus, these statements about its effects 
should be taken with some caution.) 

FD schedules are useful only when the target behavior can be 
measured conveniently and accurately and reinforced on the basis of 
its duration. One should be very careful not to assume that this is the 
case for any target behavior. Presenting reinforcement contingent 
upon a child’s studying his homework or practicing the piano for an 
hour may work satisfactorily. On the other hand, it may reinforce sit- 
ting at the desk or in front of the piano more than it reinforces 
studying or practicing. This is Particularly true for something like 
studying, where it is difficult for the parent or teacher to observe 
whether the desired behavior is occurring (the child may be day- 
dreaming, or reading a comic book hidden in his text). Practicing the 
piano is easier to monitor because the Parent or teacher can hear 
whether the child is doing his lesson appropriately.* 

The most common use of FD Schedules in training programs is 
with target behaviors that one wishes to occur st 
fixed period of time. Eye contact is 
monly reinforced on an FD schedu 
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on. If an average of fifteen continuous seconds of the behavior are re- 
quired for reinforcement, we call the schedule a VD 15-second sched- 
ule; if an average of twenty-five seconds are required, we call it a VD 
25-second schedule; and so on. 

Some of the above examples of FD schedules from the natural 
environment might be thought of more appropriately as VD sched- 
ules. Rubbing two sticks together, for example, does not always re- 
quire exactly the same length of time to produce fire (unless exactly 
the same conditions—such as the size, shape, and dryness of the 
sticks—are present each time this is done). As with many basic 
schedules, it is difficult to find common examples that precisely fit 
the definition of a VD schedule. One approximation is that of wait- 
ing in a ticket line. This example satisfies the definition of a VD 
schedule in two respects: (1) the amount of time one must wait in 
line for a ticket varies with the length of the line when one enters it, 
the speed of the ticket seller, and other factors; and (2) if one steps 
out of line (i.e., ceases to engage in appropriate waiting behavior), 
then one has to start again at the end of the line to obtain the rein- 
the ticket). The example is not perfect, however, because the 
the line and how fast it is moving give some indication of 
how long one must wait for a ticket; so, this time is not completely 
unpredictable. For another example of a VD schedule, see Figure 5-2. 

ided that the average amount of time required for the be- 
een increased fairly gradually, the char- 


forcer ( 
length of 


Prov 
havior to be reinforced has b 


ime i WHAT DO YOU MEAN, 
THIS IS A VD. SCHEDULE /? 
IM JUST GETTING A KISS, 


ule. 


FIGURE 5-2. Example of a variable-duration sched 
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acteristic effect of a VD schedule is that the behavior S 
uously for long periods of time. In this respect, it is like FD. 
Moreover, if the time requirement is too large or is increased ne i 
idly, the behavior will decrease drastically or will not occur ata ; 
Typically, however, we would expect less pausing after reinforcemen 
in a VD schedule than in an FD schedule. (VD, like FD, has not per 
studied as much as some of the other schedules discussed here, an 
so it is difficult to make very definite statements about its effects.) 

A VD schedule can be used effectively with any target behavior 
for which an FD schedule is appropriate. It is not as convenient to 
use as an FD schedule, and so it is not used as often. The nurses did 
not use a VD schedule with Benny for the same reason they did not 
use FD: it would have required continuous monitoring of his behav- 
ior, which was not convenient because of their other duties. 


CEMENT: 

LS OF INTERMITTENT REINFOR 

doe WORKS TO THE DISADVANTAGE OF THOSE WHO 
ARE IGNORANT OF IT 


The most common pitfall of intermittent 
not only the unitiated, but also those wi 
ior modification. It involves what may 


use of extinction. For example, a parent may at first attempt to ignore 
a child's tantrums. But the child persists, and in despair the parent 
finally "gives in" to the child's obnoxious demands for attention, 
candy, or whatever. Thus, the child obtains reinforcement on a VR or 
VD schedule, and this leads to further persistent tantruming in the 
future. Many times, parents and Staff say that they had to give in to 
the child's demands because "extinction was not working.” However, 
the resulting intermittent reinforcement produces behavior that is 
even more persistent and hence takes much longer to extinguish than 
behavior that has been continuously reinforced. 

In our work, we have en 
screamed until exhausted an 
the same thing again. (This i 
Eventually, 


reinforcement often traps 
th some knowledge of behav- 
be described as inconsistent 


reinforcement. 


GUIDELINES FOR THE EFFECTIVE USE OF 
INTERMITTENT REINFORCEMENT 


To use intermittent schedule: 
taining desired behaviors, it 
rules. 


s effectively in generating and main- 
is important to observe the following 
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N 


. Choose 


. Choose 


. Use appropri 


a schedule that is appropri 
e th priate to the behavi i 
Dad yg ee i cuna For example, for the reasons P E ui 
n , FL, an , were not a i 's si MEI 
whereas VI/LH was. ppropriate for Benny’s sitting behavior 
a schedule that is convenient to admini 
r minister (but, of i 
e first rule). For example, although VD ie E 
ere 


consistent with thi 
the latter was much more conve- 


appropriate for Benny’s sitting behavior, 
nient to administer than the former. 
ate instruments and materials to d i 
s a etermine 
hen the behavior should be reinforced. For beri | ea 
71 
: : make sure that you have a counter of SCA 
sort—be ita fancy wrist counter (as used for keeping golf scores), a st: je 
of beads, or simply pencil and paper. Similarly, if you are usin P is 
val or duration schedule, make sure you have an accurate Hue pei 
priate to your schedule. If you are using a variable schedule Ded a cava 
ou have arranged to follow a sequence of random numbers that m 
ry 


around the mean you have chosen. 

The frequency of reinforcement should initially be hi : 
tain the desired behavior, and should then be picid pier d 1 TARN 
the final desired amount of behavior per reinforcement is Si y 
tained. Recall that for Benny, the average interval was at first e pod 
and was then increased gradually. To take another example, sup d poe 
wanted to maintain a particular behavior on FR 100. First, Wc Ke Ra 
reinforce the behavior for awhile; then put it on FR4 for awhile, th MA 
10; and so on, until the desired performance is achieved. Alwa js Ee 3 
at each stage long enough to insure that the behavior is strong. "t ou iu 
crease the requirement too rapidly, the behavior will deteriorate dl ped 
will have to return to an earlier stage (possibly continuous alent es 
in order to recapture it. This is similar to the shaping procedure yes 


in Chapter 4. 


conveniently w 
are using a ratio schedule, 


he individual, in language he can understand, of the 


. If possible, inform t 
ing with him. 


procedure you will be usi 


Study Questions 


(for exam 


. Explai 


. What is t 
. Explain why VI sched 


ules that occur ine 


ination purposes) 


edule is. Give two examples of VI schedules that 
at least one of which is not in the text). 

ar to and how it differs from Fl. 

f a VI schedule? 
have much appl 


examples of VI/LH sched- 
in the text). 


n what a VI sch 
occur in everyday life ( 


Describe how VI is simil 
he characteristic effect o 
ules do not ication in training pro- 
grams. 

Explain what a 


le is. Give two 


VI/LH schedu 
(at least one of which is not 


veryday life 
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25. 


26. 


. Explain why FD might not be a ve 


. Describe how a VD schedule is simila 


. State two possible applications of VD 
. Explain why a VD schedule was not 


. Explain what sort of instrum 


Describe how a VI/LH schedule is similar to and how it differs from a 
simple VI schedule. 


What is the characteristic effect of a VI/LH schedule? 


Describe what happens if the VI portion of a VI/LH schedul 
or is increased too rapidly. 


What practical advantage does VI/LH have over FI/LH? 


e is too large 


. State two possibe applications of VI/LH in training programs. 
. Explain how VI/LH was used to teach Benny to sit and wait patiently. 
. Explain what an FD schedule is. Give two examples of FD schedules that 


occur in everyday life (at least one of which is not in the text) 


ry good schedule for reinforcing 
studying behavior. 


. State two possible applications of FD in training programs. 
. Explain why FD was not used to teach Benny to sit and wait patiently. 
. Explain what a VD schedule is. Give two examples of VD schedules that 


occur in everyday life (at least one of which is not in the text). 


r to and how it differs from an FD 
schedule. 


- What is the characteristic effect of a VD. schedule? 
. Explain what hap 


pens if a VD schedule is too large or is incre 


} wh ased too 
rapidly in size. 

. For what type of target behaviors are VD Schedules useful? 

à Explain why VD might not be a very good schedule for reinforcing study 
behavior. 


schedules in training programs. 
H used to teac : ait 
patiently. h Benny to sit and wai 


ents and materials i w 
you would use them, to imple you might use, and ho 


Lu 2d ment each of the following schedules: 
b) VR f) FI/LH 

c) FD g) VI 

d) VD h) VI/LH 


. Give 
How is the appropri Seep: 
or FD schedule sj 


Study Exercises 


(to be practiced by the reader) 


L 


The schedule during the | 
à att i 
5-minute/LH Mets trem hehe e dde Bis yi eee e 
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2. Assume that the following behaviors have been established: 
a) dishwashing behavior of roommate or spouse 
b) dusting behavior of teenage son or daughter 


c) completion of a mathematics assignment by a student 


You are now faced with the task of maintaining them. Following the 


guidelines for the 
in detail the best schedule to use and how you might apply it in order 


to maintain the above behaviors. 


Self-Modification Exercise 


(to be practiced by the reader) 


Assume that you have been assigned a 400-page book to read during the 


next few days. Select an appropri 
best schedule on which to dispense the reinforcer. Describe the reasons for 
your selections, and outline the mech 
program and complete it successfully. 


Wolf, Hanley, King, Lachowicz, and Giles (1970) used this method, 
which they called the “timer-game,” to increase the in-seat behavior of 
sixteen low-achieving children in a remedial class. The authors noted, 


“The timer-game was an effective technique for decreasing out-of-seat 
ractical since it did not require continuous 


behavior. ... It was also p 
monitoring by the teacher. The teacher needs to observe only the out- 
of-seat behavior that occurred when the timer rang." 

The timer-game was not uniformly effective for all the children. 
But one child whose out-of-seat behavior remained high when her in- 
seat behavior earned points only for herself showed good improvement 
when her in-seat behavior also earned points for the four students who 
sat closest to her. Speculating about this, the authors remarked, “The 
peer points condition resulted in more control over Sue's out-of-seat 
behavior than the individual points condition. Exactly what the peers 
contributed to the effect must await further analysis. Our impression 
was that they provided a number of consequences and other functions 
for Sue. For example, if she stood up. she was immediately reminded to 
sit down. If she broke her pencil, which she often did, one of the four 
peers would volunteer to sharpen it for her. If she went to the lavatory, 
she was reminded to hurry. However, the extent of their attending be- 
havior was not determined." 


The terms ^ fixed-duration 
ule" are not in standard use. In fact, there are no standard terms denot- 
ing these two schedules, app 
tant measurable property is duration have no 

in basic research (see note 1 of Chapter 5, Se 
ion schedule" in reference 


Clayton (1970) used the term "response durati 
to a procedure in which reinforcement occurre 
down for a continuous fixed time. But we 


(Continued) 


effective use of intermittent reinforcement, describe 


ate reinforcer for yourself, and identify the 


anics of how you might implement the 
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duration schedule” for this type of schedule because we can thereby 
distinguish it from the type we call a "variable-duration schedule.” 
Moreover, these schedules may be applied to an entire activity—not just 
a single response. Because fixed-duration and variable-duration sched- 
ules have not been studied as extensively as the other schedules de- 
scribed in this book, the statements we make about them are somewhat 
more speculative than those we make about the other schedules. 


There is evidence that when FR and FD both appear to be appli- 
cable, the former schedule is preferable. Semb and Semb (1975) com- 
pared two methods of scheduling workbook assignments for elemen- 
tary school children. In one method, which they called "fixed-page 
assignment," each child was instructed to work until he finished fifteen 
pages. In the other method, "fixed-time assignment," each child was in- 
structed to work until the teacher told him to stop. The amount of time 
he was required to work was equal to the average amount of time he 
spent working during the fixed-page condition. In both methods, each 
child received free time if he correctly answered at least eighteen of 
twenty randomly selected workbook frames; otherwise, he had to redo 
the entire assignment. On the whole, the children completed more work 


and made more correct response under the fixed-page condition than 
under the fixed-time condition. 


Study Questions on Notes 


1. Might it be better to reinforce a child for dusting the living-room fur- 
niture for a fixed period of time, or for a fixed n iter 
E A ARSE umber of items dusted? 


2. Describe Wolf et al.'s "timer-game." 


3. Is it accurate to say that Sue (in the Wolf et al i 
1 . Study) received boot- 
leg reinforcement? Why or why not? (Hint: Check D in Chapter 3.) 


CHAPTER 6 


TYPES 
OF INTERMITTENT 


REINFORCEMENT 
to Decrease Behavior 


“Tommy, a little less talking out please” 


DECREASING TOMMY'S TALKING OUT 

en-year-old boy classified as trainable mentally retarded 
he most disruptive student in his special 
om.* He frequently engaged in inappropriate talking and 
during class. The behavior was troublesome not so 
s nature, but because of the high rate at which it oc- 
as therefore undertaken, not to elminate it, but rather 


bothersome level. 
"talking out," Was given the following 


teacher or classmates without 
or humming to oneself; and 


Tommy, an elev 
was judged by hi 
education classro 
other vocalizations 
much because of it 
curred. A program w 


to reduce it to a less 

The undesirable behavior, 
precise behavioral definition: “talking to the 
the teacher's permission; talking, singing. 
*This case study is based on Dietz and Repp (1973). 
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ing class discussion." A practice 
jeu. enc d eges bistros ane ie Tommy's talk-outs during 
se ee session per day. (A second trained observer iu recorded 
E és i of the observations. 
Tow et ble cubes Vis Pese was recorded for ten sessions. 
3 Pd nus fusis averaged about one talk-out every nine minutes 
E eur er minute). In phase 2, Tommy was told the definition of a 
oe id Line that he would be allowed five minutes of free play 
ARE d r the end of the day if at the end of the fifty-minute session 
ibo pad M tes or fewer talk-outs (i.e., less than about one every seven- 
"s Apu a At the end of each session, Tommy was told by the teacher 
spoliis ui met the requirement, but during the session he was never 
ic -outs recorded. 
o PDE quite effective. During phase 2, which lasted 
ifteen sessions, Tommy averaged about one talk-out every fifty-four minutes 
a minute). Moreover, he never exceeded the upper limit of three 
PT mtn ife third and final phase, the above reinforcement schedule was 
removed and Tommy was told that he would no longer receive free time for 
low rates of talk-outs. Over the eight sessions of this phase for which data 
were taken, his rate of talking out increased to an average of one every 
thirty-three minutes (.03 per minute). Although this rate was much higher 
than the rate during the treatment procedure (phase 2), it was still a great 
deal lower than the rate before the procedure was introduced (phase 1). 
Thus, the treatment had a beneficial effect even after it was removed. 


DIFFERENTIAL REINFORCEMENT OF LOW RATES 


If reinforcement occurs only when responding is occurring at a low 
rate, responding will subsequently tend to occur at a low rate. This 
phenomenon is called differential reinforcement of low rates. Tommy’s 
case illustrates one way that low-rate behavior can be differentially 
reinforced. In that case, an interval was specified (fifty minutes) and 
reinforcement occurred at the end of the interval if it contained fewer 
than a specified number of responses (three talk-outs). 

This method, like those discussed in Chapter 5, involves a 
schedule of intermittent reinforcement. The schedule is called “DRL,” 
which stands for "Differential Reinforcement of Low Rates." There 
are several types of DRL schedules. The type used with Tommy is 
useful when two conditions hold: (1) some of the behavior is toler- 
able, but (2) less of it is better. In Tommy's case, the teacher felt that 
three talk-outs per session would not be too disruptive; 


no doubt, 
she would have preferred none at all, but she did not wish 


to impose 
too stringent a requirement on Tommy. Therefore, Tommy could earn 
his five minutes of free time by making three, two, one, or zero talk- 


outs during any given session.! 
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DIFFERENTIAL REINF 


Sometimes, however, the behavior you want to reduce is not 
only tolerable but desirable—as long as it does not occur at too high 
a rate. For example, a student who always volunteers the correct an- 
swer deprives his classmates of the chance to respond to the teacher’s 
questions. Naturally, we would not wish to eliminate this child’s be- 
havior; we would hope, rather, to reduce it to a more appropriate 
level. We might do this by placing the behavior on the following 
type of DRL schedule: any target response that occurs after five 
minutes of the previous target response is immediately reinforced; 
any target response that occurs within five minutes of the previous 
target response is not reinforced. This is called a "DRL 1-response/5- 
minute schedule.’ This type of schedule requires that responses be 
emitted in order for reinforcement to occur. On the type of schedule 
used with Tommy, the individual need not respond at all in order to 
obtain reinforcement. 

Eating is a particularly good example of behavior that is desir- 
able at a moderate rate but that often occurs too rapidly. Some over- 
weight people eat their meals so rapidly that they finish a normal 
portion well before the end of a normal mealtime. As a result, they 
perhaps do not experience a “full” or "satisfied" feeling until long af- 
ter they have passed the point of satiation. In such cases, it might be 
beneficial to reinforce eating bites of food on a DRL schedule. Meals 
would then be eaten at a slower rate, which would tend to promote 
less eating (see Stuart and Davis, 1972, pP- 89-90). 

Another use of DRL would be to reinforce slow speech in a stu- 
dent who speaks too rapidly. The student would He asked questions 
(such as "How are you?" or ^Where do yon live?”) for which stan- 
dard responses are reinforced — but only if they encompass a certain 
minimum time period whose length is determined by what the 
teacher regards as a normally acceptable rate of speech. 


ORCEMENT OF ZERO RESPONDING 


th Tommy might have specified an 
ree talk-outs per fifty-minute pe- 


s used frequently enough to merit a special 
ced "D-R-Oh^), which stands for “Differential 
"3 Had this schedule been used 
“DRO 50-minute sched- 


edule used wi 


The type of DRL sch 
ed rather than th 


upper limit of zero r 
riod. This schedule i 


name — DRO (pronoun 
Reinforcement of Zero Responding. 
with Tommy, it would have been called a 
iust o eliminate a behav- 
tantruming by placing it on 
hedule for this purpose might be DRO 15- 


t involve resetting 4 stopwatch to zero 
“tick off” seconds 


used when one wishes t 


DRO is frequently 
n can eliminate 


ior. For example, a perso 
a DRO schedule. A good sc 


migh 
seconds. The procedure setti 
each time a tantrum occurred and allowing it to 
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when the tantrum stopped. Reinforcement would occur when a con- 
tinuous fifteen seconds had elapsed with no tantruming. When the 
nonoccurrence of the behavior is under good control of this contin- 
gency, the schedule should be increased—for example, to DRO 30- 
seconds. The size of DRO should continue to be increased in this 
fashion until (1) the behavior is occurring very rarely or not at all and 
(2) a minimum amount of reinforcement is being given for its nonoc- 
currence.* 


PITFALLS OF DIFFERENTIAL REINFORCEMENT OF LOW RATES: 
HOW IT WORKS TO THE DISADVANTAGE OF THOSE WHO ARE 
IGNORANT OF IT 


DRL is used commonly and unknowingly by parents, teachers, and oth- 
ers to decrease the frequency of behavior that in actuality they would 
like to maintain at a high rate. Consider what happens when a child 
starts performing well in school—by giving correct answers to ques- 
tions, for example. At first, the teacher is quite impressed and enthu- 
siastically reinforces the behavior. But as the rate of the behavior in- 
creases, the teacher gradually becomes less impressed. This is 
“obviously a bright child,” and so one expects a high rate of good 
behavior from her. Thus, the reinforcement gradually decreases, per- 
haps to zero, as the rate of the behavior increases. Eventually, the 
child learns that she obtains more reinforcement if she performs at a 


mpressed with good behavior 


teachers should precisely define 
at a high rate. They should then 
vior on an appropriate schedule, 
"impressed" with it on any par- 


GUIDELINES FOR THE EFFECTIVE USE OF 
DIFFERENTIAL REINFORCEMENT OF LOW RATES 


ain it. Similar guidelines 


for effective usage apply to all types of Schedules: 
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N 


Choose a schedule that i 
at is appropriate for th i 

duce. For example, ne moala ack bypitediy = cod you want to re- 
a not wish or need to eliminate completely. aei Otea BARGER BOE 

se appropriate timing devices to de ins 

: 3 term 
poen reinforcement should occur. For cee fa d ey 
stopwatch is almost essential; for others, a simpl p iae schedules, a 
nary clock will do. P-e CBE tuner Or an ordi- 
The frequency of reinforcement ini 

| should initially be hi 
[os the nonoccurrence of the undesirable a EE ta main 
c ecreased gradually. Some individuals, particularly those eie Meus 
instructions, may be able to sustain a relatively low fre ven kag iy e 
Heaters Tommy, for example, did quite well even dud Ye From me 
orced, at most, only once every fifty minutes. Other individ i decir 
tially require more frequent reinforcement. SERM M: 
If possible, inform the individual, in language she can understand, of th 

, of the 


procedure you will be using with her. 


Study Questions 
(for examination purposes) 


10. 


Describe briefly, point by point, how Tommy's talking out in clas 
reduced. SWR 
Explain what 
occurs in every 
Describe the type of DRL schedul 
lowing conditions hold: (1) some o 
less of it the better. 

Describe the type of D 
want to reduce is desira 
least one 0 


ting a behavior problem. 
e is. Give an example of a DRO schedule 


a DRL schedule is. Give an example of a DRL schedule that 


day life. 
e that is useful when both of the fol- 


f the behavior is tolerable, but (2) the 


RL schedule that is useful when the behavior you 
ble as long as it occurs at a specified rate. ý 
f which is not in the text) of how DRL 


Explai 
that occurs in eve 

Give two examples (at least one of which is not in the text) 
might be useful in treating a behavior problem. 
Describe how DRL works to the disadvantage of peopl 
of its effects. Give an example. 

Explain how DRL and DRO differ from the intermittent-reinforcement 
schedules discussed in Chapter b. 

What happens if the frequency of reinforcement on DRL or DRO is too 
low or is decreased too rapidly? 


of how DRO 


e who are ignorant 


Study Exercises 
(to be practiced by the reader) 


1. For each of the two types of DRL schedules cited in study questions 3 and 
` 4, describe two possible applications in training programs with retarded 

children. Describe in detail how you would program and administer DRL 
in these situations. 

2. Describe two possible applications of DRO in programs of early-childhood 
education. Describe in detail how you would program and administer 
DRO in these situations. 

3. Explain what sort of instruments and materials you might use, and how 
you might use them, to implement DRL and DRO. 


case, low rates). Both of the above uses im 
contingent upon responding, although at a 


c i ime period can be represented dia- 
grammatically. 
An interesting application of this type of D 


(Continued) 
100 


101 


(Continued) 
sepa aR ans low rate also generalized to the twelve-hour period 
was not in effect, and was maintained tw 
: , enty- 
hous per day during a one-year follow-up period. This study is ek 
no avery in that no reinforcers were utilized other than the natural 
reinforcement gained by controlling the frequency of urinating 


Sometimes, the O in DRO is said to stan i 
Whether you think of it as standing for zero RESP KOE E 
to make little practical difference. The distinction lies in REESE ru 
want to think of the schedule as reinforcing no responding of a Su: 
lar type (for instance, no talking out), or whether you prefer to think of 
it as reinforcing any behavior other than the specified response (for in- 
stance, anything other than talking out). The term omission training has 
also been used to refer to a DRO procedure (see Uhl and Garcia, 1969) 
In other words, a reinforcer is presented only if a particular response is 


omitted during a given time period. 


In a basic experiment with pigeons, Zeiler (1971 
with extinction as response-elimination cedet E 
were reinforced until they occurred at a high rate. One response was 
then placed on extinction, and the other was reinforced on a DRO 30- 
second schedule. The behavior on DRO decreased more quickly than 
the extinguished behavior. 

Weiher and Harmon (1975) applied DRO to reduce the head bang- 
ing of a fourteen-year-old retarded child: The boy’s head was a mass of 
scar tissue as a result of his self-destructive behavior, and, con- 
sequently, he was kept in restraints. Prior to the DRO program, the boy 
was fitted with a padded cap that allowed freedom of movement but 
prevented injury. During observation sessions in which the boy wore 
the protective cap, he banged his head at a rate of approximately fif- 
teen ‘thumps’ per minute. Training sessions were then initiated, again 
with the boy wearing the protective cap in order to prevent injury. Dur- 
ing the first seven sessions, reinforcement (a half-teaspoon of apple- 

tle) was presented on a DRO 3- 


sauce dispensed through a baby’s bot 
seconds for head banging. Sessions were conducted twice per day and 


varied in duration from several minutes to twenty-five minutes. During 


the next few sessions, the DRO was gradually increased and then made 
ion, the DRO varied from fifteen to ninety 


variable. By the fiftieth sess ] om 
seconds. The results wer i uccessful in eliminating this dan- 
gerous behavior. As a result of this treatment, the boy was able to enter 
training programs designe 

Not all uses of DRO have prove 


Deitz (1975) noted two important differences en “s 
eis cand studies of DRO reported in the applied literature: (1) the 


i i the DRO schedule 
unsuccessful studies used larger starting values for l 
than did the successful studies; (2) the successful studies used DRO 
starting values that were approximately equal to the mean intervals be- 
tween instances of the target behaviors prior to the introduction of the 


DRO schedule. 

Repp et al. (1976) successfully 
such as hair twirling, hand biting, thumb suck 
ior in retarded individuals. 


(Continued) 


used DRO to reduce behaviors 
ing, and disruptive behav- 
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(Continued) 
Study Questions on Notes 


4. How does the use of the term DRL adopted in this text differ from 
the use of that term by Sidman? 


2. What does the O in DRO stand for? Explain. 
3. Compare the DRL schedules for Tommy's talk-outs and the univer- 
sity student's frequent urges to urinate, in terms of the following: the 
behavior; its initial frequency; its final frequency; the reinforcer; and the 
duration of the program. 
4. If you wanted to decrease a behavior, would you ap incti 

n ] ply an extinction 
program or a DRO schedule. Justify your choice. (Hint: 
PL Nolo mado) (Hint: There are two 
5. What are two differences between the successf 
Sets tooo DRO? sful and unsuccessful 
6. Compare and contrast DRO with FD. 


CHAPTER 7 


Doing the Right Thing 
at the Right Time and Place 


is a Matter for 


STIMULUS CONTROL 


«Now, Girls, Let's Sit Quietly and Watch TV" 


LEARNING TO SIT QUIETLY AT THE RIGHT TIME AND PLACE 
good deal of time in the TV 
der around, play with each 
Id sit quietly. Although 


s of Cedar Cottage spent a 


room.” At times, they would watch TV, wan 


other, or play with the staff. Occasionally, they wou 
the staff generally approved of the children mingling and doing what they 


pleased in the TV room, there were occasions when it was desirable for 
them to sit quitely — such as during staff discussions with visitors, and staff 
meetings. Although the children did sit quietly on occasion, this behavior 
ally did not occur when the staff desired it. This was clearly a situation, 


The resident 


usu 


d profoundly re- 


e for thirty severely an 
ken from Martin 


sa self-contained residenc! 
This case study was ta 


*Cedar Cottage i 
at The Manitoba School. 


tarded girls located 
(1972). 
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then, in which the desired behavior (sitting quietly) was in the children’s re- 
pertoire but did not occur at the desired times. 


The procedure for developing appropriate quiet behavior at the right 
times consisted primarily of two contingencies. First, a distinctive green 
light was turned on at specific times during the day, and a staff member 
would announce, "Okay, children, the light is on. Everyone sit down and 
be quiet." The light was left on for about fifteen minutes. Immediately fol- 
lowing the announcement, a second staff member would take those who 
were standing or moving around and guide them to a seat in the TV room. 
Another staff member would then walk around the room and reinforce, 
with praise, tokens, and/or candy, those children who were sitting quietly. 
Reinforcement was presented on a variable-interval two-minute schedule 
(approximately) with a very short limited hold (approximately fifteen sec- 
onds). This was the first contingency. While the light was on, those resi- 
dents who got up from their seats and were extremely noisy were immedi- 
ately presented with a verbal "No! The light is on" and were taken to a 
time-out room for a brief period (usually from two to five minutes). (Time- 
out is discussed in more detail in Chapter 12. In general, a time-out room 
is a small, usually empty room. A child placed in such a room loses the 
opportunity of earning positive reinforcement in other'rooms.) This was 
the second contingency. After several weeks of this procedure, the green 


| n, not only did the residents im- 
but the six residents who had been taught to 


serve in the dining room sat down 
[ and refus i 
the meal until the light was turned off. sensu the agaia 


STIMULUS CONTROL 


A stimulus i i 
‘S 1s any physical event or Object in the environment. Books, 


sound 

Pere, pens, people, trees, and shoes are all stimuli. Certain re- 

a ae in the presence of some stimuli and not others. This is 
stimulus control.' Consider the behavior of Picking up a tele- 


ing “Hello.” For most people in our culture, 


hello (the response). 
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this procedure invol i i i 
co —À n a response in the presence of one 
guishing it) in the pei of uia cm E eee yg ag os 
presence of the stimulus of a ringing ebd ne saisi Rain 
ing up the phone and saying "Hello," we oe verra err ji d 
someone answer. (However, the reinforcement ees em a eir 
mittent. For instance, the caller may ha incon ars n pen 
ume l y hang up without speaking, or 
y be someone with whom we do not wish to talk.) In th 
E rn stimuli of a nonringing phone, if we Pam lr bs 
picking up the receiver and saying “ m i 
ceca hoa perit ying "Hello," we are not reinforced by 
One of the authors recently had the opportunity to watch hi 
two-year-old son learn to answer the telephone. On doen i is 
when the phone rang and it was known that Grandma was ph me : 
the boy was reinforced by the conversation with Grandma Posen 
on several occasions thereafter, the boy picked up the shone aoc 
“Hello” even though it had not rung. On those occasions, there " 
no reinforcement. Eventually, he learned to pick up the neater and 
say "Hello" only when the phone rang. In more general terms, a be- 
havior is likely to occur in the presence of stimuli that were peanente 
es of that behavior were reinforced; a behavior 
in the presence of stimuli that were present 
f that behavior were extinguished. 
and from casual observation, it can be 
h behavior occurs can be analyzed in 
terms of three sets of events: (1) the stimulus conditions that exist 
f the behavior; (2) the behavior itself; 


just prior to the occurrence 0 
and (3) the consequences of the behavior. The stimuli that exist just 


prior to a response can be placed in one of the two general classes— 
SPs and S's. If an event is a stimulus in the presence of which the oc- 
currence of a specified response will be reinforced, then that event is 
called an S? (pronounced “ess-dee”) for that response. That is, an SP 
is a signal that a particular response will pay off. If an event is a 
stimulus in the presence of which a specified response will not be re- 


rced, then that event is called an S* (pronounced "ess-delta") for 
gnal that a particular response won't 


when previous instanc 
is not likely to occur 
when previous instances 0 

From the above example, 
seen that any situation in whic! 


info 


that response. Thus, an S? is a si 
pay off. 
The symbol SP is an abbreviation for the term discriminative 
there are two types of dis- 


e Greek letter D. Thus, 
SPs, which are associated with reinforcement, 


ted with extinction or nonreinforcement. 


Through discrimination t dividuals learn to emit responses 
in the presence of SPs and learn not to emit them in the presence of 
S^s. In our example of a child learning to respond to the telephone, 


the stimulus of a phone ringing is an SP for the response of answer- 


stimulus. A is th 
criminative stimuli: 


and Sês, which are associa 
raining, in 
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ing the phone because that response will be reinforced when the 
phone is ringing. The stimulus of a phone in view but not ringing is 
an S* for the response of answering the phone because that response 
will not be reinforced when the phone is not ringing. This can be 
diagramed as follows: 


(an instance of positive reinforcement) 
1. $9, ————————— Response ——— — ——  Reinforcer 


(phone ringing) (picking up receiver (someone answers) 
and saying ‘‘Hello’’) 


(an instance of extinction) 
DOE | > Response «———————. No Reinforcer 


(phone not ringing) (picking up receiver (no one answers) 
and saying "Hello'') 


In the case study at the beginning of this chapter, the green 
light on in the TV room was the S? for sitting quietly, since the chil- 
dren were reinforced when they sat quietly in its presence. The green 


light off was the S? for sitting quietly, since when the light was off 
the children were not reinforced for sitting quietly. This may be dia- 
gramed as follows: 


(an instance of positive reinforcement) 
j.p tul. ——*  Respunse———————s Reinforcer 
(green light on) (sitting quietly) (candy and praise) 


(an instance of extinction) 
Response ~ No Reinforcer 
(sitting quietly) (no candy or praise) 


2. $8 ——_—__________, 
(green light off) 


A phrase that is frequently used in connection with the type of 


diagram shown above is contingency of reinforcement, According to 
Skinner (1969, P. 7), an "adequate formulation of the interaction be- 
tween an [individual] and [his or her] environment must always 
specify three things: (1) the Occasion upon which a response occurs, 
(2) the response itself, and (3) the reinforcing consequences. The in- 
terrelationships among them are the 'contingencies of reinforce- 
ment.'"* Thus, extinction is a contingency of reinforcement; an FI 
Schedule is a contingency of reinforcement; and any arrangement 


among stimulus, response, and consequences is a contingency of rein- 
forcement. 
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(the dependent variables) as separate events, and regarded the envi- 
ronment as influencing behavior in a reflexive sense. Of all of Skin- 
ner’s contributions to psychology, possibly the most important is his 
discovery of how the interrelations between behavior and the envi- 
ronment (in other words, contingencies of reinforcement) as indepen- 
dent variables affect future behavior as the dependent variable. 

It is an interesting exercise to take any situation in which we 
find ourselves and examine the stimulus control of some of our be- 
haviors.' Consider the typical awakening-in-the-morning scene for 
most of us. Stimuli indicating morning —such as daylight in the win- 
dow, specific configurations on clocks, and the sound of an alarm 
clock — are typically Ss for the behavior of rising and getting dressed. 
The call to breakfast is likely an SP for entering the dining area and 
eating. The cues associated with having just eaten breakfast are likely 
S?s for washing, brushing one's teeth, and combing one's hair. Pres- 
sure on the bladder and distention of the bowels are SPs for going to 
the toilet. 

Our culture and physical environment set up stimuli as SPs and 
S^s for our behavior, but we are not always "appropriately" con- 
trolled by those SPs and Sês. Suppose that a child finishes the main 
course at mealtime and demands of his mother, "Gimme dessert!" in- 
stead of asking, “Please may I have my dessert?" Let us suppose, fur- 
ther, that the parents decide that when the child has finished his 
main course, only a polite request for dessert ("Please may I have my 
dessert?") will be reinforced. In other words, the empty plate in that 
situation is an SP by definition in that it is a stimulus signaling that 
a particular response (such as asking "Please may I have my des- 
sert?”) will be reinforced. Although the parents have set up that 
stimulus as an 9P, it may take several trials (and perhaps some in- 
structions by the parents) before the child finally emits the appro- 
priate behavior. Thus, stimuli may be set up as SPs by one's parents 
(or peer group), but they do not necessarily control one's behavior. In 
many situations, the appearance of a lady standing beside a door 
with an armful of groceries is an SP for someone to open the door for 
her, and that behavior is likely to be reinforced with social approval. 
The sight of a hitchhiker is an 5^ to a and be reinforced by the 

i :ker's gratitude and companionship. 
ipee of this sort could be cited at length. d up ue i 
the stimuli in these examples are SPs by definition, in that appr ; 

i emitted in their presence would be followed by re 
qu Ns stimuli frequently do not actually control vu be- 
m NEUE is therefore helpful to 
havior of the ipee llus Pm a D us di hes a. me 
pen rn muri stimuli for some behavior. Con- 
eue dose are sometimes referred to as effective SPs and S*s, 
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whereas SPs and $s that are such by definition but do not control 
the behavior are often called ineffective. Some examples of ineffective 
SPs and Sês are shown in Figure 7-1. 

The failure of one individual to respond to the discriminative 
stimuli provided by another can be a major source of difficulty in a 
variety of interpersonal situations. For example, husbands and wives 
often provide each other with ineffective S"s and Ss. Even though a 
spouse may not be "in the mood” for love-making, the partner may 
not respond to the subtle cues provided. Individuals often experience 
certain moods: they may be preoccupied with other matters, they 
may feel somewhat tired, depressed, or excited, and so forth. Some- 
times these private behaviors are signaled very obviously, and some- 
times the signals are not so obvious. When other individuals do not 
respond to the Ss and S*s provided, unpleasant interactions 
frequently follow. A comment, a glance, a touch, or a smile may 
mean far more or far less than was intended by the individual mak- 
ing the comment or doing the glancing, touching, or smiling. Misin- 
terpretations occur between lovers, parents and children, friends, and 
employers and employees. It is often extremely helpful to analyze 
these situations in terms of the problems of ineffective stimulus con- 
trol, M at least one of the individuals in such situations has not 
gine ee MIRI, ile a Rod 

: : priate responses to S^"s and S4s are dis- 

cussed later in this chapter. 
mm e of ineffective stimulus control might be de- 
es of failure to discriminate. Additional difficulties 


arise from failure t ; aaa. à : 
Chapter rr ilure to generalize. These difficulties will be discussed in 


FACTORS DETERMINING THE EFFECTIVE 
STIMULUS CONTROL NESS OF 


1. Choosing distinct signals 


If it is important to d i 
dfitis evelop stimulus control i 4 
havior, it is desirable to identif i Ener 


tinctive. For example, y controlling 5?s that are very dis- 


Fiet iod ae is in the case of the parents who wanted to teach 
Stimulus BS ease may I have my dessert?" in response to the 
€ empty plate following the main course, it would be 


diei 

Pets uide ie to do a number of things designed to make 

eae a x Paro distinctive. For instance, one of the parents 

tr s : ild, wipe the empty plate clean, and say, "Boy, do 

D IE nese plate; you ate everything! Would you like your 

— cd ? he other hand, the parents sometimes provide the 
en a tew pieces of food are left on the plate, sometimes when 


| 


nur 


1. Examples of ineffective S°s and S*s. 


FIGURE 7 
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the plate has some gravy and a piece of bread sitting at the side, or 
sometimes when the plate has a lot of a particular item on it because 
the child did not want that item, then the stimulus that they wish to 
function as an S? for the desirable response is much more difficult to 
discriminate from other stimuli (namely, having slightly more food on 
the plate), and the discrimination training is likely to go more slowly. 
Similarly, some of the misunderstandings between lovers, friends, 
and others might be averted if the stimuli that were meant as SPs 
were made much more distinctive and described to the other person. 
(Techniques that help people present clearer discriminative stimuli to 
indicate their needs and feelings to others are collectively called as- 
sertive training. These techniques are discussed in Chapters 14, 15, 
and 16.) 

When considering a stimulus that you are setting up as an SP 


for the behavior of another person, you might ask yourself the fol- 
lowing questions: 


1. Is the stimulus different from other stimuli along more than one dimen- 


sion? That is, is it different in location, size, color, and sensory modality 
(vision, hearing, touch, and so on)? 


Is the stimulus one that can be presented primarily on occasions when the 
desired response should occur, so that confusion with the occurrence of 
the stimulus on other occasions is avoided? 


3. Is the stimulus such that there is a hi 
ing to it when it is presented? 


Have you thought about undesirable responses that might be controlled 


by the chosen stimulus? If some undesirable response follows the stimu- 
lus, it will interfere with the development of new stimulus control wit 
the desired response.? 


gh probability of the person attend- 


Careful attention to these questions will increase the chances 
that your stimulus control is effective rather than ineffective. 


2. Minimizing the Opportunities for error 


Let us return to the example of a child learning to answer a 
phone when it rings, but not if it doesn’t ring. The response of pick- 
ing up the phone if the phone has not been ringing is a response to 
an S*. This kind of response is typically referred to as an “error.” 
Stimulus control can be developed much more effectively when the 


teacher attempts to minimize the possibility of errors on the part of 
the student. For example, 


1 if a parent is trying to teach a child to ap- 
propriately answer the phone, the parent might move the phone out 
of reach if the phone is not ringing and add verbal prompts of this 
we don’t answer telephones when they are 
not ringing. We only answer them just after they've begun to ring.” 
Then, as soon as the phone rings (perhaps a Phone call from a friend, 


made specifically for training purposes), the parent can immediately 


sort: "Now remember, 
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place the phone in front of the child and say, "Hey, the phone is 
ringing. Now you should answer it. Right?" 

At this point you might be thinking, "But often we want to 
teach people to respond to subtle cues. Why should we then max- 
imize distinctive signals and do funny little things to minimize er- 
rors?" Let us simply reply that choosing distinctive cues and min- 
imizing errors will lead to more effective stimulus control than might 
otherwise occur. In Chapter 8, we will discuss techniques for gradually 
introducing discriminations involving very subtle cues. For the mo- 
ment, it is important to keep in mind that efforts to choose dis- 
tinctive signals and to minimize errors will lead to the development 
of effective stimulus control more quickly and with much less frustra- 
tion for the student (and the teacher too) than attempts to develop 
discriminations that involve very subtle cues.’ 


3. Maximizing the number of trials 


As we mentioned in Chapters 2 and 3, instances of positive rein- 
forcement and extinction have the effects, respectively, of increasing 
and decreasing behaviors after several repetitions (even before any 
really obvious behavior change would be noticeable to a casual ob- 
server). Likewise, effective stimulus control is developed after a per- 
son reinforces the desired behavior in the presence of SPs on a num- 
ber of trials and alternatively presents the S4s on a number of trials 
in such a way that erroneous responding is minimized. In general, it 
is well accepted that a number of reinforced trials are necessary for 
the development of consistent behaviors in the retarded and other 
behaviorally deficient individuals. What many people forget is that 
this is true for all of us when we are acquiring new discriminations. 
In the previous example of a husband and wife, one of whom is "not 
in the mood,” it is important for that partner to realize that the other 
y not learn to respond to subtle cues, or even obvious 
wo trials. (In fact, some learning theorists have 
trial discrimination learning never occurs.) 
nces of reinforcement for correct responding 
ol the response on several sub- 
o longer be forth- 


partner ma 
cues, with just one or t 
hypothesized that one- 
After a number of insta 
to the SPs, those SPs will likely contr 
sequent trials, even though reinforcement may n' 


i i i basis. 
coming or may come on an intermittent 


OL: HOW IT WORKS TO THE 


PITFALLS OF STIMULUS CONTR 
DISADVANTAGE OF THOSE WHO ARE IGNORANT OF IT 


stimulus control is no 
rved by one of the au- 
d his head against 


sapplied, and 
the case, obse 
d boy who bange 


method can be mi 
e of this is 
old retarde 


Any effective 
exception. An exampl 
thors, of a seven-year- 
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b) 


c) 


ate during a dozen or so of the opportunities for the behavior, ae 
it is not occurring in S* situations, it might be possible to gra ae 
eliminate contrived reinforcers and maintain the behavior with soci 
approval. ) l P 
e for other natural reinforcers in the environment that might died 
tain the behavior once it is occurring in the presence of S"s and not i 
the presence of S?s. l ; 
Plan periodic assessments of the behavior after the program is dent 
nated in order to ensure that it is occasionally being reinforced, atu 
that the desired frequency of the behavior in the presence of S"s is 
being maintained. 


Study Questions 
(for examination purposes) 


wo OND 


10. 


11. 


12. 
B. 


14. 


. Define and give an example of an S?- 
. Define and give an example of an S^ 


. Identify examples of SPs and Sê 


: CONS ; ? 
What is the difference between a stimulus and a discriminative stimulus? 


. What is the difference between stimulus control and stimulus-discrimi- 


nation training? 


. Shaping and stimulus-discrimination training are similar in that they 


both involve successive applications of reinforcement and extinction. In 
what two ways are they dissimilar? 


. What is a synonym for an effective S»? 


. For any two stimuli that have been set up as an S and an S^, but whose 


relationship to the behavior is best described as in 


effective stimulus con- 
trol, what would be the behavior in the presence o 


f these stimuli? 


What are “contingencies of reinforcement"? Explain. 


s as follows: two SPs from Table 2-1; two 
SPs from Table 2-2; two S4s from Table 3-1; and two S?s from Table 3-2. 


What questions might you ask yourself when you are considering the se- 
lection of a stimulus to be set up as an S? for the behavior of another 
person? (See p. 110.) 


For each of the questions that you asked yourself in the preceding ques- 
tion, provide an example from your own experience. 
What do we mean by an error in discrimin 
Consider the task of teachin 
ment of a knife, fork, and sp 
things that one might do, 
possibility of errors. Descri 
Describe an examp! 
one’s disadvantage 


ation training? 

8 a child to discriminate the proper place- 
oon at a table setting. There are a number of 
before and during training, to minimize the 
be three such things. 


le of how ignorance of stimulus control may work to 


Study Exercises 
(to be practiced by the reader) 


1: Identify five SPs that controlled your behavior during the past day or two. 
Clearly identify the general situation, the controlling SP, the behavior con- 
trolled, and the reinforcement contingency. 

2. Identify five situations in which you presented an SP that controlled the 
behavior of some other person. Write the situations clearly as in the pre- 
vious exercise. 

3. Describe five situations in which you presented an S* to some other per- 
son. Label the situations clearly, as in exercises 1 and 2, and indicate 
whether or not the S? controlled the behavior appropriately. 

4. Briefly describe a situation in which someone close to you has not been 
doing the things that you like him or her to do, and you suspect the 
problem is that you are not presenting clear-cut SPs and Sês. Describe 
how you might develop better stimulus control over the desired behavior 


in that person. 


Self-Modification Exercises 
(to be practiced by the reader) 


behavior of yours that you might like to decrease. 


1. Choose an excessive 
ose situations in which the behavior 


For that behavior, carefully monitor th 
occurs and does not occur over à two- or three-day period. Clearly identify 


the controlling S?s and, if possible, some controlling S^s for the behavior. 
Such information will prove to be extremely helpful if you should decide 
later to set up a self-control program after completing this book. 

2. On the basis of the material you have read thus far in this book, describe 
in detail how you might set up specific control of your study behavior so as 
to improve your learning of the discriminations that are necessary 1n master- 
ing the remainder of the material in this book. (Hint: consider stimulus con- 
trol, reinforcement, extinction, incompatible behaviors, and schedules of re- 
inforcement.) 

3. Select one of the behavioral inappropriatenesses that you listed at the end 
of Chapter 1. Describe in detail the stimuli currently controlling the behav- 
ior. Describe in detail the stimuli that you would like to control the behav- 


ior. 


SION AND NOTES 


EXTENDED DISCUS 
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q 1 H 1 ” 
(or Iowa) rate in the presence of the light than in its absence. e 
technically speaking, it is not necessary for a pareu ENR fe 
i f a particular stimulus in order 4 

cur only in the presence o icul e E c thar the 

i ntrols the response; it is necessary nly o 
Her FT the presence of the stimulus to be in some manner dif 
ferent from the behavior that occurs in the absence of that stimulus. 


h we have adopted Skinner's use of the term “contingency, 
enone use the E E e e A 
; rne, ; Rey i , 

on ruat n "contingencies" as follows: a dependency 
pene hen a reinforcer has been scheduled to follow a response such 
MAE resentation of the reinforcer depends on the occurrence of 
ami ee a contingency exists when a reinforcer closely follows a 
me Tuum but the relationship is accidental. According to Skinner both 
GE these ‘relationships would be contingencies. However, Skinner has 
differentiated between the two types of contingencies, in arguing that 
many superstitious behaviors (such as rain dancing) are due to acci- 
dental contingencies (such as rain occurring after a rain dance). In our 
view, the meaning of contingency that we have adopted in this text is 
by far the more popular interpretation. 


Often, behaviors that appear perplexing to the uninformed are easy 
to understand to an individual knowledgeable about stimulus control. 
For example, some children may be little angels with one parent and 
little monsters with the other. Relatives, outside viewers of the situation, 
and sometimes the parents themselves find it difficult to comprehend 
the Dr.-Jekyll-and-Mr.-Hyde behaviors of the children. Such contrasts 
are easily understood in terms of stimulus c 
consider an experiment by Redd and 
two adults worked with the sam 
times. One adult provided candy, 
much praise when the children 


ticular adults, children generally emi 
likely to reinforce. If a Child is a "monster" in your presence, check the 
reinforcement contingencies that 


In some situations, individuals in our culture hope that others will re- 
Spond to particular stimuli as Ss, 


the particular stimuli fun 
government official: i 

to function as S?s for the general public such that the public would de- 
posit their litter rather than being litterbugs. Accordingly, governments, 
(Continued) 
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stores, and various other organizations have placed li 

litter bags in a variety of locations, along Wc 
uals to deposit their litter. Often, however, there is no reinforcement for 
individuals who respond (although there may be an occasional punisher 
in the form ofa fine for being a litterbug). The obvious result is that a 
number of individuals do not respond in desired ways to litter bags and 
trash cans. This was clearly demonstrated in an interesting experiment 
by. Burgess, Clark, and Hendee (1971), who evaluated procedures t 

control littering by children in two movie theaters in Seattle, Washin 
ton. Their study clearly indicated that providing litter bags with SUE 
tions. on how to use them, providing extra trash cans, and showing a 
special antilitter film before the feature film in the theaters had Be: 
tively little effect on the littering behavior of the children. Only when 
given reinforcement for returning the bags full of litter (either ten cents 
or a free movie ticket) did the children respond appropriately. 


This difficulty was taken into consideration by Goldiamond (1965) in 
an interesting study in which he helped a husband and wife overcome 
their quarreling behavior. By utilizing reinforcement and counseling 
procedures, they wished to develop desirable stimulus control over 
pleasant interaction. One of the stimulus situations chosen as an S? for 
pleasant interaction was the bedroom. However, the bedroom con- 
trolled an undesirable behavior in the sense that it was a scene of 
frequent quarreling in the past. The problem was therefore to find a 
stimulus that would change the appearance of the room completely, 
and yet be easy to apply and withdraw. The solution was to install a yel- 
low night light, which markedly altered the perceptual configuration of 
the room. The night light was turned on as an S? only when both indi- 
viduals felt amorous; it was kept off on all other occasions. Eventually, 
desirable stimulus control was developed in the bedroom (and other lo- 
cations too), and communication between the husband and wife im- 


proved greatly. 


Procedures to develop discriminations in which the S? and the S^ 
are presented alternately for set periods of time, and in which re- 
sponses to the S? are reinforced and responses to the S* are extin- 
traditional discrimination-training procedures. Even- 
tually, after many errors, the individual learns to discriminate and 
responds primarily to the SP- Terrace (1963) demonstrated that discrimi- 

i inimal errors, or none at all. In an ex- 
periment on training pigeons to peck at a plastic response key when it 
was illuminated with re o not peck when it was illuminated 

d the S? for a few trials and rein- 


with green light, he initially presente 
forced an appropriate response by the pigeons. The S^ was then pre- 
‘aeons did not have a chance to 


sented very briefly (so briefly that the pige V 
respond) an nt form from what it would even- 


d in a completely differe 
tually be. Over a number of trials, the form of the S^ was gradually 
changed an d so that eventually the S? and ee 


d its duration increase à l 
were alternating for equal periods of time. Since the pigeons made very 
few or no errors, this approach has been called the errorless discrimi- 


nation-training procedure. f : TN 
In a study with severely retarded girls, McDonald, Martin, Williams, 
and Hardy (1973) demonstrated that errorless discrimination-training 
to traditional procedures in teaching the girls 


rocedures were superior i te 
t3 recognize their names. Each girl taught by the traditional discrimina- 


(Continued) 
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(Continued) 


tion-training procedure was presented with her name and one other 
name in randomly alternated positions and was asked to identify her 
own name. Correct pointing (pointing to one’s own name) was reinforced, 
and incorrect pointing (pointing to the other name) was extinguished. 
The girls in the errorless discrimination-training group were initially 
presented with their names and a blank card. Over a number of trials of 
alternating the position of the cards, more and more printing was pre- 
sented on the blank card; eventually, girls were discriminating their 
own names from other names. The girls taught by the errorless proce- 
dure performed better during training, and they retained their behaviors 
more effectively during a five-month follow-up. 


To this, you might say, "That can't be right; | know I've sometimes 
learned to respond correctly in just one trial.” It is true that the behav- 
ior that follows a particular stimulus may occur correctly after just one 
trial. However, that is not the typical discrimination development that 
we have been describing. An example of the sort of situation that you 
are thinking of in which a discrimination seems to develop in one trial 
might be putting money in a cigarette machine and receiving no ciga- 
rettes. After pounding on the cigarette machine (showing the frustration 
that we talked about in Chapter 3), you are likely to find another ciga- 
rette machine, complain to the manager, or emit some other appro- 
priate behavior. However, you are not likely to put more money in the 


offending machine at that time. This type of situation has been labeled 
discriminated extinction. In other words, 


scrin : h you are discriminating a situ- 
ation in which further responding on your part will be extinguished, and 
you are making this discrimination after one trial. The important thing 
to keep in mind, however, is that you have undoubtedly had similar ex- 
periences (or observed similar experiences had by others) in very sim- 
ilar situations. If we were to combine all of these situations your dis- 
crimination would Probably be seen to have developed over several 
trials. Alternatively, if we were to take a vending machine and a lot of 
money to a primitive culture, we would 


Study Questions on Notes 


1. How does the technical definition of 

. How the r stimulu: i 
simplified definition given in the text? Give s AE sau ee Pee 
trate the difference. Vah br eer 


2. Explain how different authoriti 4 
and "dependency." uthorities have used the terms "contingency 


3. How might you explain the behavi 

wm avior of a 
angel with one parent and a "holy terror" Ws 
an experiment supporting your explanation 
4. What is an important inferenc j| 
the littering Study by Bergess et 2 dad dun Dia Had 
5. What is discriminated extinction? 
(Continued) 


ild who is usually a “perfect 
th the other? Briefly outline 


Explain in terms of S?s and S^s. 
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Developing 
Appropriate 


Behavior 


With FADING 


“Peter, what's your name?” 
TEACHING PETER HIS NAME 


when asked "What's your nam 
would repeat the entire question, “ 


lem of stimulus control in Which questions (stimuli) evoked mimicking re- 
sponses rather than appropriate answers. 


? England, Kaprowy, Kilgour, and Pilek, (1968), and 
a Paper presented to the Amer- 
n Ulrich, Stachnik, and Mabry, 
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Using the following procedure, a university student, Veronica, taught 
Peter to respond appropriately to the question "What's your name?" First 
Veronica identified an effective reinforcer. Since Peter had previously been 
taught to work for plastic tokens that could be exchanged for treats such 
as candy and popcorn, Veronica decided to use the tokens as reinforcers 

Peter sat at a small table in a quiet room, and Veronica sat across 
from him. In a very soft whisper, Veronica asked "What's your name?" 
then, very loudly and quickly and before Peter could respond, she shouted 
"PETER!" Of course, Peter mimicked the word "Peter," and Veronica rein- 
forced this with “Good boy!" and a token. You may wonder how this 
could represent any progress, since the boy was still only mimicking the 
student. However, over several trials Veronica began asking the question 
"What's your name?" more loudly and began supplying the answer "'Pe- 
ter" more quietly. In each case, she continued to reinforce the correct re- 
sponse-— "Peter." Eventually, Veronica asked loudly "What's your name?" 
and simply mouthed the word "Peter." Nevertheless, the boy responded 
with the correct answer, "Peter." Over several trials, Veronica ceased even 
mouthing the correct answer, but Peter still responded correctly to the 


question "What's your name?" 


Fading is the gradual change of the stimulus controlling a response, 
such that the response eventually occurs to a partially changed or 
completely new stimulus. In the case described above, Peter would at 
first say his name only when it was said to him. Through a fading 
process, the stimulus control over the response "Peter" was gradually 
transferred from the stimulus “Peter” to the stimulus "What's your 


name?" 
In any situation in which a stimulus exerts strong control over a 


can be a very useful procedure for changing the 
stimulus control The discovery and development of fading tech- 
niques have led to some dramatic changes in educators’ views re- 
garding the learning process. At one time, it was felt that people had to 
make mistakes while learning in order to know what not to do. How- 
ever, errorless transfer of a discrimina 
least three advantages over procedures involving trial and error. First, 
errors consume valuable time. Second, if an error occurs once, it 
tends to occur many times, even though it is being extinguished. 
(Remember from Chapter 3 that during extinction, "things may get 
worse before they get better.") Third, the nonreinforcement that oc- 
curs when errors are being extinguished often produces emotional 
side effects such as tantrums, aggressive behavior, and attempts to 


escape from the situation. 
We have used fading procedures in many learning situations in 


response, fading 


tion can occur, and it has at 
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rograms with retarded and autistic individuals.' In teaching stu- 

Uwe e name an item of clothing—a shirt, for example- teachers 
E . . = z 
might proceed according to the following instructions: 


i "shirt." Keep doing this until the student con- 

E ine s ya rue ud ke pner. ana immediately reinforce 

dos wed ud response. (This assumes that you have a student who is able 

Morea cartiegie word. It also assumes that the student has been 
ained to look at any item you point to.) l ; 

2. When the student consistently mimics "shirt," present the stimulus ped 

; ou want to control the response, and at the same time gradually fade ou 

the stimulus "shirt." That is, you might say, "What's this? Shirt" while 

pointing to the shirt. In response, the student usually mimics ‘shirt.” 

Over several trials, gradually decrease the intensity of the stimulus “shirt” 

to zero, so that the student eventually responds with the answer shirt 

to the stimulus of someone pointing at his shirt and asking "What's 

this?" Again, each appropriate response is to be reinforced. 


In this way, children can be taught to name a variety of objects. 
We have also used fading to teach other behaviors— for example, 
tracing, copying, and drawing circles, lines, Squares, triangles, nu- 
merals, and letters of the alphabet. To teach a student to trace a circle, 
the teacher might begin with a large number of sheets on each of 
which is a heavily dotted circle. The teacher places a pencil in the stu- 
dent's hand, says “Trace the circle,” and then guides his hand so that 
the pencil traces the circle by connecting the dots. Immediately after 
this, of course, the student receives a reinforcer. After several such 
trials, the teacher fades out the pressure of her hand as a cue con- 
trolling the student's tracing, by: 


lightly holding the student's hand for several trials; 


touching her fingertips to the back of the student's hand for several trials; 
pointing to the item to be traced; 


finally, simply giving the instruction, “Trace the circle.” (Steps 1, 2, and 3 
are always accompanied by this instruction.) 


PONE 


Once the teacher has tau 
him to draw or copy, 
tracing. For example, t 


the procedure is repeated for 
On subsequent steps, 
the student will draw 
simple matter to fade i 


to this newly 
acquired response. Th 


e instruction "Copy a circle," said while the 
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teacher points to a circle, can also be faded in and come to control 
the response. Teaching the student to copy many different figures in 
this fashion will eventually enable him to adequately copy figures 
that he has had little or no experience copying. 

Thus far, we have talked of fading in a rather restricted sense— 
that is, in the sense that fading can be used to change stimulus con- 
trol when a specific response occurs to a rather specific stimulus 
(such as in the example in which the specific response "Peter" was 
brought under the control of specific stimulus "What's your name?"), 
Fading can also be used to maintain appropriate behaviors when the 
general situation changes. For example, in one of the authors' pro- 
grams with autistic children, we wanted to have a group of autistic 
boys respond appropriately in a classroom setting (Martin et al, 
1968). But these boys were very disruptive, especially in a group 
situation. This being the case, we could not at first place them in a 
classroom setting. Thus, we decided to first obtain the desired behav- 
ior from each child in an individual situation, and then fade in the 
classroom setting. 

Our initial training sessions were conducted in a small room in 
which there were several chairs and tablet-arm desks. Two or three 
teachers (university students) worked individually with two or three 
students in a one-to-one ratio. The procedures involved eliminating 
tantrums through extinction, and reinforcing sitting attentively, ap- 
propriate verbal behavior, drawing, copying, and other desirable be- 
haviors. Each child's desk was placed against the wall in such a fash- 
ion as to make it difficult for him to leave the situation. 

Within one week, the children learned to sit quietly, attend to 
the teacher, and mimic words in verbal training. Stimulus control 
was established between the general training situation and the chil- 
dren’s attentiveness. But our goal at that time was to teach the chil- 
dren to sit quietly in a regular classroom situation with one teacher 
at the front of the class. If we had switched immediately to this situ- 
ation after the first week, however, much inattentiveness and dis- 
ould no doubt have occurred. Therefore, over a 
we gradually changed from one small room 
e teachers to a standard-size classroom 
her. This fading occurred along two 


ruptive behavior w 
period of four weeks, 
with three students and thre 
with seven students and one teac 


stimulus dimensions. 
One dimension was the physical structure of the room. We 
i he regular large class- 
he children from the small room to t 
rase? g the three tablet-arm desks 


i i lacin; 
room. However, we did so by first p f 
against the wall of the regular classroom, just as we had done in the 
t the teachers sat in were also moved 


small room. The three chairs tha 

to the regular classroom. The rest of the classroom was empty. Over 
several days, the tablet-arm desks were gradually moved away from 
the wall and toward the center of the room until, finally, the three 
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desks were side by side. Additional desks and furnishings were 
added one at a time until the children were finally sitting in desks in 
i sroom. 

í PE dde was the number of children per teacher. 
Fading along this dimension was carried out at the same time that 
fading along the first dimension took place. At first, one teacher 
worked with one student for several sessions. The teacher then 
worked with two students, alternating questions between them for 
several sessions. In this fashion, the student/teacher ratio was gradu- 
ally increased until only one teacher worked with as many as seven 
children in a classroom situation. 

It can be seen from this case that fading procedures can be use- 
ful in generalizing the results of training in a controlled, relatively 
simple situation to the more complex settings that exist in Society at 
large.” The problem of generalizing the results of behavior modi- 
fication to the "real world" will be discussed in more detail in Chap- 
ter 11. 

Extreme care should be taken to avoid confusing fading with 
shaping. Both are procedures of gradual change. However, as de- 
scribed in Chapter 4, shaping involves reinforcement of slight 
changes in a behavior so that it gradually comes to resemble the tar- 
get behavior. The stimulus situation generally stays about the same, 
and the behavior changes from an initial behavior (not necessarily re- 
sembling the target) to the final target behavior. Fading, on the other 
hand, involves reinforcement of a specific response in the presence of 
slight changes in a stimulus so that the stimul 
resemble the stimulus that you wish to con 
sponse. Thus, shaping involves the gradual change of a response while 
the stimulus stays about the same; fading involves the gradual change of a 
stimulus while the response stays about the same. 


us gradually comes to 
trol that particular re- 


USING FADING PROCEDURES TO TEACH VERBAL SKILLS 
TO SEVERELY RETARDED AND AUTISTIC CHILDREN 


Because of the importance of language skills in our culture, we would 
like to indicate in some detail the potential use of fading procedures 


in this area. We are not going to describe a completely self-contained, 
highly detailed trainin 


8 program for the development of language. 
Such programs are des 


cribed elsewhere (see, for example, Kent, 1974). 
Rather, we would like to talk about some procedures that relied heav- 


ily on fading and were used Successfully to develop extensive verbal 
skills in severely retarded and autistic children. 

The first step in many verbal-training programs involves the use 
of reinforcement procedures to teach motor and sound imitations. Let 
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us suppose that this has already been accomplished. One can then 
use a fading procedure to teach the student to imitate words. For ex- 
ample, to teach the student to mimic “cat,” present the following cue: 
“Say ‘cat.’ Caa ... tuh.” Wait until the student mimics "caa" before 
presenting the stimulus “tuh.” Reinforce the student immediately af- 
ter he correctly imitates the last sound (in this case, "tuh"). Continue 
doing this, and at the same time gradually fade out the stimulus 
“tuh.” (One reason for fading out “tuh” before fading out "caa" is 
that over several trials, "caa" will become a strong stimulus for evok- 
ing “tuh.” Moreover, the response “tuh” is followed more immedi- 
ately by reinforcement, and should therefore be easier to maintain as 
some of its stimulus support is gradually removed.) 

Now you have the student responding with "caa ... tuh” to the 
stimulus “Say ‘cat.’ Caa." The next step is to fade out the "caa." You 
will then have a student who responds with "caa ... tuh" to the 
stimulus “Say ‘cat.’ " 

After reinforcing this last behavior a number of times to make 
sure it is strong, you can now teach a new word by using the same 
procedure. Keep giving the student occasional practice with words 
that have been learned, in order to make sure that they remain 
strong. 

But, you may ask, shouldn't the student be taught next to say 
"cat" instead of "caa ... tuh"? This is perhaps a reasonable ap- 
proach, but it may be better not to bother with it at this stage. Over 
a number of trials in the natural environment, the student will very 
likely begin running the sounds of words heus and RC pro- 
nouncing them just like everyone else. Even if this does not happen, 
: h a large number of words that are pro- 
it may be better to teac! 8 DOS hi 
nounced imperfectly than to spend a great dea e m teas 2 2 
few words perfectly. Being able to communicate would seem to de- 


iori i ble pronounciation. 
rve priority over impecca 
rin die student imitates a number of sounds and words, he 


ught to name a variety of objects. In many cases, the 
ea imber wishes to teach the individual to wee Mie 
readily available. In our verbal-training ie agria a sid ERR 
literally hundreds of pictures that have been purc ey b pne 
i ly companies or cut out of magazines an catalogu 
ies rae rd ces of cardboard. We then use fading to teach the stu- 
Mm the ictures. One picture at a time is taught, but it is 
ea ted pene trials, with a picture the student has already 
mue pU ngres that the student is actually naming the picture 
pe a eating the same word. After the student has been 
ues uet di qoem we find that the fading procedure is often no 
re Sake The student learns to respond with the name of the 
ong . 


object after he has simply been told what it is. 
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Teaching an individual with limited verbal behavior to ae 
objects does not proceed easily. It requires Chien. asta 
ten, it appears that no progress is occurring, or seg ma ru e 
being lost. Remember, however, that even a normal c - req = 
several years to learn to talk in a rudimentary fashion. : ur expe - 
ence has been that one can often see good progress with ae se 
verely retarded individuals after three to six months of one one-hour 
sessions per day — especially if the individual is quite young. 

When the student can name a number of objects, training may 

eed in a variety of directions. Regardless of the particular direc- 
= he teacher decides upon, fading procedures can be very helpful. 
cea the following use of fading to teach an eight-year-old autis- 
tic boy to count objects." Danny had participated in a token-rein- 
forcement program in which he earned poker chips that could be ex- 
changed for food, candy, and other goodies. He had increased his 
attention span and had learned to identify and recite the numerals 
1 through 10. To teach Danny to count up to ten objects, the teachers 
developed a detailed training procedure that utilized fading. Danny 
was required to complete ten consecutive correct trials at each of six 
steps before progressing to the next step. Whenever Danny made an 
error on any step after step 1, he was moved back to the previous step 
and again required to complete that step correctly on ten consecutive 
trials in order to advance. After Danny had progressed successfully 


through all six steps for a given numeral, he was returned to step 1 
for the next numeral. The steps were as follows: 


Step 1. Danny received a sheet of white Paper with a numeral printed on the 
upper right-hand corner and a corresponding number of circles 
drawn on the paper (see Figure 8-1A 
pointing to the numeral, such as B, if 


Orrect response. After ten 


consecutive correct trials, Danny was moved to step 2 of the training 


procedure for that particular numeral. 
Step 2. The procedure remained the same as in step 1, except that the out- 
lines of the circles were finer (see Figure 8-1B) 
Step 3. The procedure was the sa xcept that the outlines of 


the circles were now broken lines (see Figure 8-1C). 
Step 4. The procedure was the same as in 


Step 5. 


"This case is taken from Murrell, 


Hardy, and Martin (1974), 
mission of the publisher. 


and is paraphrased by per- 
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Step 6. The procedure was th 


c D 


FIGURE 8-1. The stimulus sheets used in Danny's fading program. 


per was not placed on Danny's desk. Instead, at the start of the trial 


Danny was shown the appropriate numeral cut from felt material and 
asked, "Danny, what number is this?" When Danny correctly identi- 
fied the numeral, such as 5, the teacher said, "Good boy, Danny. 
Now place five circles on your desk." After correctly doing this, he 
received reinforcement. As in all previous steps, Danny had to com- 
plete ten consecutive trials correctly before moving on to the next 


step. 
e same as in step 5, except that Danny was re- 


te number of orange circles in the 
teacher's hand rather than on the desk. Following Danny's correct 
identification of the numeral, such as 5, the teacher held out her 
hand and said, "Good boy, Danny. Now give me five circles." Or 
the first trial of step 6, the teacher held her hand on the desk. During 
the second through the fifth trials, the teacher gradually raised her 
hand off the desk and held it in midair directly in front of Danny. 
During the last few trials, Danny was taking the correct number of 
circles from a pile and placing them in the teacher's hand. 


quired to place the appropria 


ten consecutive trials in step 6, the nu- 


After Danny completed 
d. He was then taught to count the next 


meral was considered learne 
numeral, proceeding throug 
learned to count objects for all 
made only six errors int 


fading was utilized in several different ways in this program. 


h the same six steps. In this way, Danny 
1 of the numerals 1 through 10. Danny 
he entire training program. You can see how 


FACTORS INFLUENCING THE EFFECTIVENESS OF FADING 
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1. Choosing the target stimulus control 


It is important to select the target stimulus (the stimulus you 
want to eventually control the behavior) such that the occurrence of 
the response to that particular stimulus is likely to be maintained in 
the natural environment. Many fading programs make the error of 
stopping with a target stimulus control that does not include some 
aspect of a stimulus that the student will frequently encounter in the 
natural environment. Consider Danny’s case. It would have been 
easy for the teachers to stop training after step 5, for Danny was 
clearly counting out the correct number of circles and placing them 
on his desk when asked to do so. However, classroom observation 
indicates that a more natural occurrence is for a teacher to approach a 
student, hold out her hand, and ask him to give her a specific num- 
ber of objects. The training program was therefore carried on through 
step 6. Moreover, the teachers conducted further training with 
Danny: following step 6, he was asked to count out other items (such 
as bingo chips, wooden blocks, and puzzle pieces of varying sizes, 
shapes, and colors) under the training procedure utilized in step 6. 


2. Choosing the starting stimulus control 


It is important to select an initial stimulus that reliably evokes 
the desired behavior. In Danny’s training program, the teacher knew 
that Danny would place a felt circle on the heavy outline of a circle if 
there was only one such outline on the 
him. Therefore, that was the starting st 
teach Danny to count. In the task of teach 
ica knew that Peter would mimic the last 
word was spoken loudly. Therefore, the starting stimulus control 
with Peter was the question, "What's your name?” said very softly 
and followed quickly by the shouted answer, “Peter!” 

The stimuli that are presented to insure the occurrence of a re- 
sponse are sometimes referred to as Prompts. In order to carefully 
identify the stimulus dimensions to be faded, it is helpful to distin- 
guish among verbal prompts, which are verbal hints or cues, gestural 


prompts, certain motions the teacher makes without touching the 
student, environmental prompts, in which th 


in a manner that will evoke the 
(also called physical guidance), 


piece of paper in front of 
imulus control selected to 
ing Peter his name, Veron- 
Word of a question if that 


; TAGES P appropriate stimulus con- 
trol of the instruction "Touch your head" over the response of the 
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student touching his head. The teacher might initiate training b 

ing, “Touch your head. Raise your hand and put it on your dis 
this," while touching his own head. In this example, “R: bes xs 
hand and put it on your head like this" is a udi sa ae 
teacher's action of putting his hand on his head is a ee a 
Selecting several kinds of prompts that, together, reliably ee ase E 
desired response will minimize errors and maximize the debe e 


the fading program." 


3. Choosing the fading steps 


When the desired response is reliably occurring to the prompt 
given at the onset of the training program, the prompts can then p 
gradually removed over trials. The steps through which the prompts 

liminated should be carefully chosen. Unfortunately, e 


are to be e 
tive use of fading is, like effective use of shaping, still somewhat of 
an art. It is very important to monitor the student’s performance 


closely in order to determine the speed at which fading should be 
carried out. If the student begins to make errors, then the prompts 
have been faded too quickly or through too few fading steps. It is 
then necessary to backtrack until the behavior is again well estab- 
lished before continuing with fading. On the other hand, if too many 
steps are introduced or too many prompts are provided over a num- 
ber of trials, the student might become overly dependent on the 
prompts. Consider the example of teaching a child to touch his head 
when asked to do so. If the teacher spends a great many trials pro- 
viding the prompt her own head, the child may become 
dependent on it an the instruction "Touch your 


head.” 


of touching 
d attend much less to 


iT WORKS TO THE 


PITFALLS OF FADING: HOW 
DISADVANTAGE OF THOSE WHO ARE IGNORANT OF IT 


ehavior principles can be applied unknowingly by 
not familiar with them, so can fading be misused. 
e difficult to inadvertently misuse fad- 
dual change in cues rarely occurs by 


Just as other b 
those who are 
However, it appears to be mori 
ing because the necessary gra 


chance. 

The case of the child who banged his he 
scribed in Chapter 7) might be an example of the effects of the mis- 
use of fading. On p. 65, we mentioned that shaping might produce 

ding is responsible for it. 


such behavior. It is also possible that fa 
at the child initially began attracting attention by hitting 


soft surfaces, such as grass. At first, this behavior may 
adults to come running to see if the child had injured 


ad on hard surfaces (de- 


his head on 
have caused 
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himself. When they eventually learned that no injury resulted from 
this behavior, they ceased providing it with attention. The child may 
then have progressed to hitting his head with the same force but on 
slightly harder surfaces, such as carpeted floors. For awhile, this per- 
haps increased the amount of attention elicited from adults, but this 
amount of attention may eventually have decreased when the adults 
learned that the child did not injure himself in this way. Only when 
the child graduated to hitting his head on surfaces such as hard 
floors and even concrete, which caused real and serious self-injury, 
did the adults give him continued attention. Note that throughout 
this example there was a gradual change in the stimulus (the type of 
floor surface) evoking the undesired behavior; eventually, the behav- 
ior was evoked by the most undesirable stimulus possible. 


GUIDELINES FOR THE EFFECTIVE APPLICATION OF FADING 


1. Choosing the target stimulus control. Specify very clearly the conditions in 
the presence of which the target behavior should eventually occur. 

2. Selecting an appropriate reinforcer. See Figure 2-2 and p.32. 

3. Choosing the starting stimulus control and the fading steps. 


a) Specify clearly the conditions under which the desired behavior now 


occurs — that is, what people, words, physical guidance, and so forth, 
are necessary, at present, to evoke the desired behavior. 

b) Specify clearly the dimensions (such as color, people, and room size) 
that you will fade in order to reach the desired stimulus control. 


c) Outline the specific fading steps to be followed, and the rules for mov- 
ing from one step to the next. 


4. Putting the plan into effect. 

a) The fading of cues should be so gradual that there 
possible. However, if an error occurs, move back to the previous step 
for several trials and provide additional prompts. 

b) When the desired stimulus control is obtained, review the guidelines in 


previous chapters for weaning the student from the program (a topic 
that is discussed in more detail in Chapter 11). 


are as few errors as 


Study Questions 


(for examination purposes) 


1. Define fading and give an example of it. 
2. Why is it advantageous to establish stimulus control without errors? 
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3. Identify three stimulus dimensions al i 
ree st ong which fadin i 
examples cited in the first two sections of this chapter. Speers in, the 
4. Describe an example from this cha i i ; 
5 pter in which the traini i i 
mained constant but a specific dimension was faded ODE 
5. Describe an example from this cha i i 
j pter in which the general traini i 
uation was faded but th ifi ini i i SEE 
Nano M e specific training stimuli remained relatively 
6. Describe how you might use fadin 
1 : g to teach your pet to perform i 
eae d you might use shaping to teach your pet i Suri A 
other trick. Drawing from your example, clearly distingui i 
d ej gehen y guish between fad- 
7. Assume that you have an eighteen-month-old child who will imitate the 
~~. chip. Dea e detail how you might use fading to teach your 
child to correctly identify a chip (i.e., a potato chi i Í 
and ask “What’s that?” R ere ee 
8. Describe two ways in which fading was used in the 
which Danny learned to count. rantes 
9. What do we mean by target stimulus control? Give an example. 
10. What do we mean by starting stimulus control? Give an example, and ex- 
plain what the target stimulus control would be for your example. 


11. What are the four major categories of prompts? Give examples from this 


chapter. 


12. How many reinforced t 
the stimuli of that parti 
were made in the examp 


rials should occur at any given fading step before 
cular step are changed? (Hint: What suggestions 


les in this chapter?) 


Study Exercises 


(to be practiced by the reader) 


1. Suppose that a two-year-old child has reached the stage where he is be- 
ginning to "explore" the surrounding neighborhood. The child has al- 
ready learned some speech, and you wish to teach him to answer the 
question, “Where do you live?" Outline a fading program with which you 

s question: indicate what you would use as a 


could teach the answer to thi 
reinforcer, the number of trials you would have at each fading step, and 


so forth. 

2. Assume that you must teach a severely retarded child, or a very young 
normal child, to eat with a spoon. Outline a program in which you would 
use all four of the major categories of prompts. Describe how each of the 
prompts would be faded. 

3. Suppose that the official t 
from Fahrenheit to Celsius ( 
you the job of designing an e 


emperature scale has been switched recently 
i.e., centigrade). The government has assigned 
ffective program for teaching citizens to re- 


spond knowledgeably to the Celsius scale. You have been given complete 
freedom to work with the radio and television weather announcers. De- 
scribe a plan that would accomplish this task. Include a precise statement 
of your target stimulus control, your starting stimulus control, and the 


fading steps you would use. 


Self-Modification Exercise 
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(to be practiced by the reader) 


A self-modification exercise in Chapter 7 required you to list the current 
stimulus control and the target stimulus control of one of your behavioral su 
appropriatenesses. Indicate in detail how you might use fading to trans er 
the stimulus control in order to overcome your behavioral Siti dr he 
(Cite the guidelines for the effective application of fading that you would fol- 
low.) 


In addition, fading has been used cleverly by Meyerson and Michael 
(1964) to diagnose the level of hearing of children who were presumed 
to be moderately retarded. These authors wanted to determine if the 
behavioral problems of the children were due to poor hearing or to 
other conditions. The authors first designed an experimental testing 
room in which two small levers were placed directly below two light 
bulbs, each arranged on a console so that it was difficult to press both 
levers simultaneously. The children were taught to press the lever un- 
derneath the light bulb that was lit. When they did so, they were rein- 
forced with candy, toys, and other items. The children soon learned to 
press the lever under the light that was lit, and to Switch to the other le- 


light went off and the opposite light was illuminated, the sound termi- 


: over a number of alternations of 
tone was presented whenever the 


An interesting example of generalizing the results of 
Ported by Conrad, Delk, and Williams (1974). The pro 
an eleven-year-old American Indian girl who interacte 
(Continued) 


training was re- 
blem concerned 
d normally with 
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(Continued) 

selected friends, siblings, and her parents but would not speak in the 
classroom. According to school officials and written records, the child 
had been totally mute in the classroom for the entire five years of her 
school attendance. Thus, the behavior of answering questions was in 
her repertoire, but it was not under the desired stimulus control. Train- 
ing sessions consisted of reinforcing the girl (initially with candy, and 
later tokens exchangeable for candy) for answering questions about 
flash cards. This behavior occurred in settings that were gradually 
faded into the classroom according to the following steps: 


Session 1: conducted in the girl's home on the reservation, with her mother and 
a mental health worker (male tribal member) present; consisted of initial in- 
structions in the girl's Indian language. 

Sessions 2 and 3: conducted in the home by the mental health worker, but with 
the mother absent. 

Sessions 4 and 5: conducted in a psychology clinic on the reservation, with the 
mental health worker and a classmate present. 

Sessions 6-9: conducted in the clinic, with the mental health worker, classmate, 


and teacher present. 
Session 10: conducted in the classroom, with five classmates and the teacher 


present. 
Sessions 11 and 12: conducted in the classroom with the entire class and the 


teacher present. 


In a one year follow-up the girl was still responding satisfactorily to the 
teacher in classroom situations. 


An interesting example of combining a variety of prompts was re- 
ported by Mahoney, VanWagenen, and Meyerson (1971) in their de- 
iption of a program to train normal and retarded children to walk to 


scri [ j to wi 
the "tollat They utilized verbal prompts (the instruction Let's go 
potty”), environmental prompts (toys placed near the entrance to the 


i : 3 i 
toilet, and an auditory signal presented concurrently with the verbal 
prompts), and guidance (taking the child by the hand). These prompts 
t as the children learned to approach the toilet on their 


faded ou r 
anh For a description of the detailed fading steps, see Mahoney et al. 


Study Questions on Notes 


son-Michael procedure might be adapted so 


i Meyer: e 
1: Describe hoy oS ar lor blindness in severely retarded children 


as to test for red-green co 


who have very little speech. | i 
2. Does the program you designed for the previous question use the 
same general classes of prompts utilized by Mahoney et al. in their 


ilet-training program? 
c ae nsions were faded in the case of the eleven- 


o general dime! , 
Med P uds Indian girl who would not speak in the classroom? 


CHAPTER 9 


Developing 
and Maintaining 


Behavior With 
CONDITIONED 
REINFORCEMENT 


“Johnny, would you like to 
cash in your pegs?” 


T CEUIDPA 


JOHNNY'S TOKEN-REINFORCEMENT PROGRAM 


As a beginning teacher at the St. Amant Centre, Nickie Martin was con- 
fronted with a classroom of ten rowdy, retarded children.* In the midst of 
this "bedlam," she was faced with the problem of consistently applying 
positive reinforcement to each Child for desirable behavior while con- 
tending with the disruptive behavior of others. 

The solution she adopted involved, in a sense, teaching each child to 
reinforce his or her own good behavior. Nickie worked With each child in- 
dividually while an aide temporarily "baby-sat" with the other children. 


tin, Joseph Pear, and Garry Marti 
children in Winnipeg, Manitoba. 
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Seating the first child, Johnny, at a table, she placed before him a board 
containing five rows of five holes in each. A wooden peg was placed in the 
hole at the top left-hand corner, and all the other holes were covered with 
tape. When Johnny attended by looking at her, she immediately said, 
“Good boy, Johnny! Cash in your peg.” Taking the child’s hand, she 
guided him to remove the peg and give it to her. Immediately following 
this action, Johnny was given a small candy, a potato chip, or some other 
agreeable item. Over a number of trials, the guidance was faded out so 
that eventually Johnny would hand Nickie the peg, upon request, without 
any assistance. 

In the next step, there was no peg in the board. But near the board 
was a small jar of pegs. When Johnny attended to her, Nickie said, 
"Johnny, take a peg," and then guided his hand into the jar and helped 
him put the peg in the board. Then she said, "Johnny, cash in your peg," 
and presented reinforcement when he complied. Over several trials, the 
guidance for taking the peg was faded out; eventually Johnny would take 
the peg and put it in the board on request, as well as remove it and hand 
it to Nickie for reinforcement when told to cash it in. The interval between 
these two instructions was then gradually increased, so that Johnny would 
sit for some time with the peg in the board. If he manipulated the peg 
when not instructed to do so, it was taken forcefully from his hand and he 
was ignored for five seconds. R 

Let us pause for a moment and review the behavior sequence that 
had thus far been established. Johnny would sit quietly until Nickie said, 
“Johnny, take a peg.” He would then reach into the jar, take a peg, and 
place it in the board. After waiting a brief period, Nickie would say, 
“Johnny, cash in your peg.” He would then take the peg out of the board 
and hand it to her. The entire sequence would then be reinforced with 
something he liked, such as a bite of candy, or potato chip. f ? 

After the above chain had been established, it was a relatively simple 
matter to teach Johnny to collect several pegs before cashing them all in 
for reinforcement. Recall that in the first phase of the procedure, all holes 

cept the one in the top left-hand corner were covered with tape. In the 
ex t phase, Nickie uncovered the hole immediately to the right of that one 
ang buit Johnny to place two pegs in the board. She did this by ig 
ina him twice to take a peg and then asking him to cash in" his 
eee DEN forcement. Eventually, Johnny would collect five pegs, place 
pea? ar wera tet hole, and return all of them for reinforcement when 
Sac ing i tion. 
given the re een “So what? Perhaps this is a good 

At this poin e aisciaxarit task, but how does it solve the problem 
way to teach s m does it help us cope with a classroom full of bois- 
we started eds answer is that once all the children had been trained in 
terolis kids” E Nickie's job of managing reinforcers for each child was 
the above uU irst, she could administer reinforcement immediately 
greatly facilitated. cs to take a peg. Second, simply by noting the 
simply by terma E dU hild's board, she could easily monitor the num- 
number of pegs in each a child received and thus maintain an adequate 
ber of reinforcements e for each. Adequate reinforcement was insured in 
amount of reinforcement orked at his or her own level (for some chil- 
three ways: (1) each child w 
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ly attending to the teacher earned reinforcers; for others, com- 
ere Vesponsee © questions were required); (2) children who might 
earn fewer reinforcers were not required to collect as many pegs to cash 
in for goodies as were children capable of earning more reinforcers; (3) 
Nickie alternated trials among the children in such a manner as to insure 
that each child received reinforcement frequently enough to maintain the 
behaviors of sitting attentively and responding appropriately. Thus, the 
number of pegs in each child's board served as S?s to control Nickie's be- 
havior. . . . 

Of course, the pegs were reinforcing mainly because they could be 
cashed in for something else that was reinforcing. That is, the "value" of 
the pegs was strengthened by other reinforcers, which were called back- 
up reinforcers. In order to maintain the reinforcing value of the pegs. 
Nickie had to let each child cash in his pegs for a back-up reinforcer after 
he had earned a specified number of pegs. Although the procedure greatly 
facilitated the task of administering reinforcement to each child in a group 
situation, the problem remained of having to interrupt the class to provide 
back-up reinforcement to children who had earned the required number of 
pegs. Nickie solved this problem by instituting two daily "store-time" peri- 
ods. During one half-hour period in the morning and one half-hour period 
in the afternoon, the children were allowed to buy back-up reinforcers. 
The available back-up reinforcers were consumable (such as popcorn, po- 
tato chips, and candy), activity (such as helping the teacher clean up the 
classroom and participating in a game), manipulative (such as a toy or 
puzzle), and possessional (such as wearing a favorite hat). Any reinforcer 
that could be administered during store-time was used. The price of each 
reinforcer (that is, the number of pegs required to buy it) differed for dif- 
ferent children. The more desirable the reinforcer to a particular child (as 
determined by how many times in the past he selected it), the higher its 
price. Also, the more pegs a child could earn, the more he had to pay. 
Some children spent all their pegs during each store-time. Others saved 
for days in order to purchase more expensive items. It can be seen that in 
addition to enabling Nickie to efficiently manage the task, the peg system 
she established taught the children concepts they would later find useful 
when they learned how to use and save money. 


CONDITIONED REINFORCEMENT 


If a stimulus indicates that reinforcement is forthcoming, then that 
stimulus itself becomes reinforcing. In the above example, pegs be- 
come reinforcing to the children because a child could receive back- 
up reinforcement if he had enough pegs but would not receive it if 
he did not have enough. 

A stimulus is called a conditioned reinforcer if it is not originally 
reinforcing, but acquires reinforcing power through association with 
à stimulus that is reinforcing. The pegs Nickie used in her class were 
not originally reinforcing to the children. No child would have 
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worked very hard, if at all, to i 
" , to get pegs for their own sak i 

dren worked hard because the pegs could be cashed is m — 

strong back-up reinforcers. Another example of condition es Hed 

forcement is praise, which seems to acquire its enn ies 

from its association with various kinds of reinforcing eerie i Ect 

when Nickie said, “Good boy, Johnny,” this verbal discum 
s 


ample, 
iated with the same back-up reinforcers with which the 


was assoc 


pegs were associated. 
Reinforcers such as popcorn and candy are usually reinforcin 
8 


in themselves. Some children just “naturally” like them. Stimuli 
as these are called primary reinforcers.” Back-up reinforcers e gs 
n e, 


but need not be, primary reinforcers. Conditioned reinforcers c 
an 


also serve as back-up reinforcers. For example, i i 
tive as a back-up reinforcer for a valid ama Edo er Te 
gambling table. But money is a conditioned reinforcer, not a i : 
reinforcer, because no one would work for money if it could not "d 
mately be exchanged for items that are more reinforcing, such " 
food, clothing, shelter, transportation, and entertainment. i , 

Conditioned reinforcers that can be accumulated and exchanged 
for other reinforcers are called tokens. A behavior modification ri 
gram that uses tokens is called a token system or a token economy. Just 
about anything that can be accumulated can be used as the medium 
of exchange in a token system (see figure 9-1). Pegs are a good ex- 
ample. In some token systems individuals earn plastic discs (such as 
poker chips), which they can retain until they are ready to cash them 
in for back-up reinforcers (see Martin et al., 1968). In other token sys- 
tems they are paid with “paper money,” on which is written the 
amount earned, the individual’s name, the name of the employee 
who paid him, the date, and the task the individual performed to 


earn the token (see Logan, 1970). In still others, individuals receive 
points, which are recor beside their name or in note- 


books they keep with th 
this last system seems similar to the old, familiar procedure whereby 
teachers award stars to children for good performance. But this long- 
standing procedure, iced, is not really a token sys- 
tem in the strict sense, bsence in it of clearly speci- 
fied, consistently admini back-up reinforcers. 
Tokens constitute one type of conditioned reinforcer, but stimuli 
that cannot be accumulated can also be conditioned reinforcers. A 
A mother who ex- 


common example, as mentioned above, is praise. 
presses her pleasure at her child’s good behavior is simultaneously 


disposed to smile at the child, hug him, play with him, and give him 
a treat or a toy. ly established as a conditioned rein- 


forcer during chi be maintained as one for 


adults. This is becaus' they are generally 


ded on a chart 


em (see Phillips, 1968). Superficially at least 


because of the a 
stered, and effective 


Praise is normal 
Idhood, but it continues to 
e when people praise us, 


ris unconditioned reinforcer (that is, a stimulus that 


mary reinforce 


*Another name for pri 
being conditioned). 


is reinforcing without 


FIGURE 9-1. Examples of tokens. 
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FACTORS INFLUENCING THE EFF 


vis likely to favor us in various ways than when they do not praise 
Although it is normal for praise to become a, conditioned rei 

forcer, this does not hold true in the case of some behaviorall h mud 
capped people. Perhaps for them, no one ever associated E Bis h 
effective back-up reinforcers. Indeed, this may be one ke for n 

behavioral handicaps. Praise is used so commonly as a reinforcer ra 
our society that any individual for whom it is not reinforcing cannot 
be expected to acquire very many socially desirable behaviors. It 
would seem that such an individual would almost necessarily become 
behaviorally handicapped—no matter what the “innate potential’ 
for her intellectual and other social development might be. Of course 

if her “innate potential" is not very great to begin with, she may 
emit socially desirable behavior so rarely that people in her natural 
environment seldom or never praise her. Thus, her lack of contact 
with praise precludes it from becoming a conditioned reinforcer, 


which makes it even more difficult for her to develop socially desir- 


able behaviors. 
It follows that those working with behaviorally handicapped 


raise becomes a conditioned reinforcer 
for them. In training programs, this is typically done by praising de- 
sirable behavior just prior to presenting other types of reinforcement 
(recall Nickie's “Good boy, Johnny! Take a peg.”). The praise then 
serves as immediate feedback that is reinforcing because it signals 
that something nice is about to happen. 

Before closing this section we might briefly mention the prin- 
ciple of conditioned punishment, which is very similar to that of condi- 
tioned reinforcement. Just as a stimulus that signals reinforcement 
becomes reinforcing itself, so a stimulus that signals punishment be- 
comes punishing itself. “No!” and “Stop that!” are examples of stim- 
uli that become conditioned punishers, because they are often fol- 
lowed by punishment if the individual continues to engage in the 
behavior that provoked them. Moreover, punishing tokens as well as 
reinforcing ones are possible. The demerit system used in the mili- 
tary is an example of a punishing-token system. There are, however, 
problems associated with the use of punishment (see Chapter 12). 


people should ensure that p 


ECTIVENESS OF 


CONDITIONED REINFORCEMENT 


1. The Strength of the Back-up Reinforcers. 
nditioned reinforcer depends in part 


ower of a co: 
the back-up reinforcer on which it is 


The reinforcing P 
ower of 


upon the reinforcing P 
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based. For example, suppose that Nickie had used only potato chips 
as a back-up reinforcer. In that case, the pegs would have been effec- 
tive reinforcers only with children for whom potato chips were an ef- 
fective reinforcer. Pegs would not have been reinforcing with any 
child who had “had his fill" of potato chips, was very thirsty, or just 
was not fond of potato chips. 


2. The Variety of Back-up Reinforcers 


The reinforcing power of a conditioned reinforcer depends in part on 
the number of different back-up reinforcers available for it. This fac- 
tor is related to the one above in that if there are many different 
back-up reinforcers available, then at any given time at least one of 
them will probably be strong enough to maintain tokens at a high re- 
inforcing strength for any individual in the program. A conditioned 
reinforcer that is based on a number of different back-up reinforcers 
is called a generalized reinforcer. Thus, the pegs in Nickie’s classroom 
were generalized reinforcers. Money is another example of a general- 
ized reinforcer because it can be exchanged for an almost unlimited 
variety of reinforcers. This is why it can keep people occupied day 
after day in its pursuit. 


3. The Schedule of Pairing with the 
Back-Up Reinforcer 


In Chapter 5, we saw that behavior is more persistent if reinforce- 
ment does not follow every occurrence of the target behavior. Like- 
wise, conditioned reinforcement is more effective if back-up rein- 
forcement does not follow each occurrence of the conditioned 
reinforcer. For example, the children in Nickie's program had to earn 


a certain number of tokens before they were given back-up reinforce- 
ment. 


4. Extinction of the Conditioned Reinforcer 


For a conditioned reinforcer to remain effective, it must continue to 
be associated with a suitable back-up reinforcer(s). Had Nickie dis- 
continued store-time in her program, the children would eventually 
have stopped working for the pegs. Ceasing to provide back-up rein- 
forcement for a conditioned reinforcer is called extinction of a condi- 


Honed reinforcer and is similar to the procedure described in Chapter 
3 for extinguishing a response. 


PITFALLS OF CONDITIONED 
REINFORCEMENT: HOW IT W 
THE DISADVANTAGE OF THOSE WHO ARE peer LET 


People who are unfamiliar with the princi iti i 

forcement may unknowingly AE Lend ota E bia 
common misapplication occurs when an adult scolds a child fo psg 
having inappropriately, but (1) does not provide any type of back. 
up punishment” (see Chapter 12) along with the scolding, and 2) 
does not reinforce desirable alternative behavior. The scoldin z 
doubt, is given in the expectation that it will be punishing E 
this is not the case. Indeed, the attention that accompanies auch n - 
ative verbal stimuli may even be highly reinforcing, especially for a 


havior 


ally handicapped individuals, who often do not receive much 


attention from adults. In this way, scoldings and other negative ver- 


bal stimuli (such as 


No!") can become conditioned reinforcers, and 


the individual will behave inappropriately in order to obtain them. 


Indee 
conditioned reinforcers throug 


d, even stimuli that are normally punishing can become 
h association with powerful primary 


reinforcers. The classic example is the parent who spanks a child for 


misbehavior an 
ing, immediately hugs the child and 


other tasty treat. The possible out 

is that the child will develop a 

spanking could become a con 

not eliminate, the misbehavior it follows. 
Extinction of a con 

plied with unfortunate resu 


d then “feeling quilty^ from the ensuing piteous cry- 
gives her ice cream or some 


come of this unthinking procedure 
“liking for lickings"; that is, the 
ditioned reinforcer that would maintain, 


ditioned reinforcer can be unknowingly ap- 
Its by those who are unfamiliar with this 
ned reinforcement. An example of this is a teacher 


aspect of conditio 
for good behavior but fails to use effective back-up 


who awards stars 
reinforcers. The resul 
forcing power they may 


GUIDELINES FOR THE EFFECTIVE USE OF 
CONDITIONED REINFORCEMENT 


The following guidelines sho 


t is that the stars eventually lose whatever rein- 
have had when they were first introduced. 


uld be observed in applying conditioned 


reinforcement.” 
1. A conditioned reinforcer should be a stimulus that can be easily managed 
d in the situation in which you plan to use it. For ex- 
e children in Nickie’s classroom. For 


and administere i 
ample, pegs Were ideally suited for th 
more advanced in 1 
items may be more appropriate. 
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2. As much as possible, use the same conditioned reinforcers that the indi- 


vidual will encounter in the natural environment. For example, Nickie did 
not just tell Johnny to take a peg when he behaved appropriately; she al- 
ways said, “Good boy, Johnny! Take a peg." Because “Good boy" was fol- 
lowed by the instruction “Take a peg," and because pegs were backed up 
by powerful reinforcers, "Good boy” also became reinforcing. Now, when 
Johnny hears “Good boy” in the natural environment (for instance, from 
his parents), he will be more likely to continue to engage in the behavior 
that evoked this stimulus. 

Carrying this rule still further, it is desirable in training programs to 
transfer control from artificial-token systems (such as pegs) to the mone- 
tary-token system used in the natural environment. Of course, this goal 
would have to be approached through gradual steps in a carefully planned 
long-range program. Such a program might consist of moving from pegs 
to different-colored plastic chips (the different colors representing differ- 
ent values), to play money, and finally to real money with which the indi- 
viduals could make purchases at the local store or canteen. Along the way, 
of course, the individuals would have to be taught some basic arithmetic 
so that they could correctly count change. 


3. In the early stages of establishing a conditioned reinforcer, back-up rein- 


forcement should be presented as quickly as possible after the presenta- 
tion of the conditioned reinforcer. Later the delay between conditioned 


reinforcement and the back-up reinforcement can be gradually increased, 
if desired. 


4. Use generalized conditioned reinforcers wherever possible; that is, use 


many different types of back-up reinforcers, not just one. This way, at 
least one of the back-up reinforcers will probably be strong enough at any 
given time to maintain the power of the conditioned reinforcer. 


5. The number of tokens that each individual in a token system should be 


required to pay for a given back-up reinforcer should be directly related 
to the strength of the back-up reinforcer for that individual. In other 
words, charge each individual more for the reinforcers she finds more de- 
sirable. This will ensure efficient use of the back-up reinforcers. (Note 
that because various back-up reinforcers differ in their value for different 
individuals, some individuals will be charged more for the same back-up 
reinforcer. This should not cause any problems if the following rule is ob- 
served.) 


6. When the program involves more than one individual (as was the case in 


Nickie’s classroom), avoid destructive competition for conditioned and 
back-up reinforcers. If one person receives reinforcement to the detriment 
of another, this may evoke aggressive behavior in the second individual 
and/or his desirable behavior may extinguish. This rule implies in par- 
ticular that one should avoid making an issue out of the fact that one in- 
dividual is earning more conditioned and back-up reinforcement than an- 
other. Of course, people differ in their abilities, but the bad effects of 
these differences can be minimized by designing programs such that each 


EUN earns a good deal of reinforcement for performing at his own 
evel. 


7. Let an individual sample back-up reinforcers that she is unwilling to buy 


with her tokens. Reinforcer sampling, as this is called, will increase the re- 
inforcing value of the tokens because it adds to the number of back-up re- 
inforcers that an individual might actually purchase.* (The rationale here 


*Reinforcer sampling was discussed in Chapter 4, note 1, with reference to Ayllon and 


Azrin (19682). 
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is similar to the one that prompts compani i 
sae ts companies to distribut 
dio igo o en dns — individuals may work siete Sak ae d : 
os Qe dim a ati em for any back-up reinforcement. In these ca He 
ee ae ne pae an effective reinforcer-sampling nd s 
ra e hd p "à ein ividual to the back-up reinforcer for toe i 
pj ab sat pes joe her to cash in some tokens in order t p. 
mper : à fora onger period. For example, a child may b Qu 
a play with for one minute and then be required to Mei inier 
in order to retain it for five minutes. Or she may be take as ee See oa 
ater, and then be required to pay ten tokens in ane ey b rhe ee 
o 


watch the movie. 
8. Prevent unauthorized acquisition of tokens Someti indi 

ot ee aea tokens from each other or ng Seat trate he 
. Seldom, if ever, are these the kinds of behaviors we SS ag 

force. Close monitoring can be effective in checking such i eaten inet 

Chapter 12). Another solution is to individualize the a pe ne ore 

the individual who earned them can exchange them for eqs Sa Eri 

ment. For example, each individual might receive as tokens ee 

with his name on them. Another method is to make out eae ide 


propriate amount of reinforcement. 
9. In addition to these eight rules, one should follow the same rules for con 


ditioned reinforcers that apply to an iti i 

ni c at a y positive reinforcer (s 

Additional details for establishing token economies daten p 
in 


Chapters 22, 23, and 24. 


Study Questions 


(for examination purposes) 


1. Describe briefly, point by point, how Johnny was taught to exchange 
pegs for back-up reinforcement. 8 
2. Describe briefly, point by point, four essential features of a token system. 
3. Explain how Nickie's peg system facilitated her job of managing rein- 


forcers for the children. 
4. How did Nickie insure adequate reinforcement for each child? 


5. How did Nickie avoid having to frequently interrupt the class in order to 


provide back-up reinforcement? 
6. How did Nickie determine how many 


for each back-up reinforcer? 
. Explain what a conditioned reinforcer is. Give and explain two examples 


7 

8. Explain what a back-up reinforcer is. Give two examples. 
9. Explain what a primary reinforcer is. Give two examples. 

10. Which of the reinforcers in Figure 2-2 are primary reinforcers and which 
are conditioned reinforcers? Defend your answer. 

money is à conditioned reinforcer. 


pegs each child would have to pay 


11. Explain why 
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. Conditioned reinforcers that can be accumulated and exchanged for other 


reinforcers are called —— X 


. Explain in two or three sentences what a token system is. Describe the 


different media of exchange used in various token systems. 


. Give two examples of stimuli that are conditioned reinforcers but not to- 


kens. Explain why they are conditioned reinforcers. 


Why is it important for those working with the behaviorally handi- 
capped to insure that praise becomes a conditioned reinforcer for them? 


. Explain what a conditioned punisher is. Give and explain two examples. 
. Explain what a generalized reinforcer is. Explain why a conditioned rein- 


forcer that is a generalized reinforcer is more effective than one that is 
not. 


. Explain what extinction of a conditioned reinforcer is. 
. A conditioned reinforcer is more effective if back-up reinforcement fol- 


lows every occurrence of it. True or false? 


Self-Modification Exercise 
(to be practiced by the reader) 


Self-modification exercise 2 in Chapter 2 required you to complete the rein- 
forcer questionnaire for yourself. Self-modification exercise 2 in Chapter 4 re- 
quired you to outline a detailed shaping program to overcoming one of your 
deficiencies. Now select several reinforcers from you reinforcer questionnaire 
and describe how they might be used in a plausible token system to carry 


out your shaping program from Chapter 4. 


Even the mild murmur ‘‘mmm-hmm,” if used as an expression of in- 
terest or approval, can have measurable reinforcing effects. As de- 
scribed in detail in Chapter 2, note 5, Greenspoon (1951) demonstrated 
this in a classic experiment in which he instructed college students to 
"free-associate" and then said "mmm-hmm" contingent upon the 
emission of plural nouns. The frequency of plural nouns increased even 
for those students who appeared (on the basis of testing) not to have 
been aware of the reinforcement contingency. Moreover, the frequency of 


plural nouns decreased when Greenspoon extinguished this behavior by 
withholding ‘‘mmm-hmm.” 


The development of a token system that will be used to effectively al- 
ter a small number of behaviors of one or two individuals is one thing. 
The development of a detailed token system that will be used to man- 
age many behaviors of many individuals is something else. The guide- 
lines described in this chapter, if used in conjunction with the guide- 
lines for the effective application of the other behavioral principles and 
procedures discussed in this book, are probably sufficient to help a 
teacher, parent, or whomever, to design a simple token system for one 
(Continued) 


145 


(Continued) 

or two behaviors of one or two individuals. However, you should not try 
to develop a large-scale token system just on the basis of these guide- 
lines. In Chapters 22, 23, and 24, we will describe many additional de- 
tails that require attention in the design of a large-scale token econ- 
omy. In addition, entire books have been written on how to develop 
token economies in specific settings. Ayllon and Azrin (1968b) de- 
scribed procedures for developing a token economy on a ward in a 
mental hospital. Cohen and Filipczak (1971) outlined in detail a token 
economy for improving the behavior of boys in the National Training 
School for Boys in Washington, D.C. More recently, Stainback, Payne, 
Stainback, and Payne (1973) and Walker and Buckley (1974) described 
easy-to-follow step-by-step procedures for designing token economies 
appropriate for classroom settings. Welch and Gist (1974) presented 
guidelines for developing a token economy in sheltered workshops. In 
addition to these "how-to-do-it" manuals for the design of full-scale to- 
ken economies, there are a number of research reports that have inves- 
tigated the effectiveness of token economies. For excellent reviews of 
these studies, see Kazdin and Bootzin (1972) and Kazdin (1975, 1977). 
Patterson (1976) editied a book concerned with solving the routine 


problems of token-economy operation. 


CHAPTER 10 


Getting 

A New Behavior 

to Occur With 
BACKWARD CHAINING 


“Giselle, will you make the bed for me, please?” 


TEACHING GISELLE TO MAKE A BED 


Giselle was an institutionalized severely retarded girl with an IQ of 32." 
One summer, one of the authors and his co-workers decided that it would 
be a good idea to teach bedmaking to some of their charges. Giselle was 
chosen as one of the pupils for this task, mainly because she would follow 
some simple instructions. 

Before beginning the bedmaking training, the staff conducted a test 
to see what Giselle could do without any training at all. They piled the 
sheets, blanket, bedspread, and pillow on top of one bed and asked Gi- 


*This example is taken from Martin, England, and England (1971), and is paraphrased 


with permission of the copyright holders, Division 22, American Psychological Asso- 
ciation, Inc. 
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selle to make the bed next to it. Und iti 

5 er these condition i 
enough to move the materials to the unmade bed, but sgt i pod 
grabbed everything in one big lump, piled it on the bed, and nisi 2 
around a little. It was clear that Giselle could not make a bed at dee 


der the test conditions. 
Making a bed consists of a complex sequence of responses that 


must be followed, one response at a time, in the proper order. It was ap- 
parent that before any progress could be made, these steps would have to 
be specified. Therefore, the entire process of bedmaking was divided into 


the following twenty sequential units or steps: 


hanc ae the bottom sheet such that it covers all or nearly all of the 
tucking in the bottom sheet at the head of the bed 

tucking in the bottom sheet at the foot of the bed 

tucking in the sides of the bottom sheet 

placing the top sheet on the bed 

pulling the top sheet up to the head of the bed 

straightening the top sheet 


tucking in the foot of the top sheet 
putting the (folded) blanket on the lower right-hand corner of the bed 


unfolding the blanket from the corner such that it covers the bottom half 


of the bed 
pulling the top layer of the blanket up such that the blanket covers the 
whole bed 

tucking in the foot of the blanket 
placing the spread on the bed 
finding the rounded corners of th 


he rounded corners at the foot of the bed 
the foot of the bed such that it covers the 


(mo M OO Ub OO - 


= 
m = 


oe 
& t» 


e spread 


= m 
voe 


. placing t 
. pulling the spread up from 
bottom half of the bed 

pulling the spread up from its halfway position such that it covers the 


whole bed 
18. pulling the spread back for the pillow 
19. putting the pillow at the head of the bed 


20. pulling the spread over the pillow 


= 
an 


= 
5l 


The training procedure, which was carried out by a nurse, in- 
volved teaching the last step first, then teaching the next to the last 
step, and so on, working backwards in a fashion that is called back- 
ward chaining. The nurse made the bed completely except for step 20. 
She then told Giselle, “Pull the spread over the pillow." Immediately 

making this request, she physically guided Giselle through the 

motions, giving additional verbal prompts along the way. 
as followed with "Good girl, Giselle!" and the presentation of 
n as reinforcement. (Giselle had already been taught 
kens to buy back-up reinforcers.) The nurse repeated 
each time giving Giselle less physical guid- 


after 
proper 
This w 
a plastic toke: 
how to use to 
the step several times, 
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ance. Each correct response was reinforced, and each incorrect re- 
sponse was followed by the verbal stimulus "no!" and a brief period 
in which Giselle was ignored. 

When Giselle had performed step 20 correctly on three con- 
secutive trials without physical guidance or verbal prompts, the 
nurse introduced step 19. She made the bed completely except for the 
last two steps. She then told Giselle, "Put the pillow on the bed" and 
physically guided her through the motion. She then told her, "Now 
pull the spread over the pillow," which Giselle did readily and with- 
out prompting. The nurse said, "Good girl, Giselle!" and presented 
her with a token after the completion of this step (step 20). Over tri- 
als, the physical guidance for step 19 was faded out, just as it had 
been faded out for step 20. Steps 19 and 20 were repeated until Gi- 
selle performed both correctly, without physical guidance, in three 
consecutive trials. In this fashion, Giselle was taught to perform steps 
18, 19, and 20; then steps 17, 18, 19, and 20; and so on, until she had 
mastered the entire twenty-step sequence. Even though Giselle was 
severely retarded, within fifteen half-hour sessions of this procedure 
she had learned to make the bed completely. 


STIMULUS-RESPONSE CHAINING 


A stimulus-response chain is a sequence of discriminative stimuli 
(SPs) and responses (Rs) in which each response produces the S^ for 
the next response; the entire sequence is typically followed by a rein- 
forcer. What Giselle had acquired in learning to make a bed was such 
a sequence of stimuli and responses. The first stimulus (S?,) for the 
entire sequence (completed in a forward fashion) was the instruction 
“Make the bed"; this was the instruction that was given in the pres- 
ence of a completely unmade bed. The response (R,) to that stimulus 
was "putting the bottom sheet on the bed." The bottom sheet on the 
bed was the stimulus (S?,) for “tucking in the bottom sheet at the 
head of the bed" (R;) The bottom sheet tucked in at the head of 
the bed was the stimulus (S”,) for “tucking in the bottom sheet at the 
foot of the bed" (R;). And so on, until the bed was completely made 
at which point Giselle received praise and a token. The reason for 
calling this procedure a stimulus-response chain can be seen by writ- 
ing it out as follows: 


S5, R, S5, R2 S5, Rs jenes Sn MC 


The stimulus-response connections are the "links" that hold the 
chain together. As the saying goes, “A chain is only as strong as its 
weakest link." Similarly, if any response is so weak that it fails to be 
evoked by the SP preceding it, the next SP will not be produced and 
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the rest of the chain will not occur. The chain will be “broken” at the 
point of its weakest link. The only way to “repair’’ the chain is to 
strengthen the weak stimulus-response connection by means of an 
effective training procedure. 

The symbol “S+” at the far right of the above diagram sym- 
bolizes the positive reinforcer that follows the last response in the 
chain. It designates the "oil" that one must apply regularly in order 
to keep the chain "rust-free" and strong. 

One major method of teaching a stimulus-response chain is 
called backward chaining. Students often find this method strange, ap- 
parently because they think that it teaches an individual to perform 
the chain backwards, as the name suggests. Actually, this is not true. 
There is a very good rationale for using backward chaining. Consider 
the example of teaching Giselle to make a bed. Backward chaining 
was the method used in that program. The response of step 20— 
“pulling the spread over the pillow" — was reinforced in the presence 
of the stimulus “pillow on the bed.” On the basis of the principle of 
conditioned reinforcement, the sight of "pillow on the bed" became a 
d reinforcer for the response immediately preceding it, 
llow on the bed." This response, in turn, was rein- 
onditioned reinforcing stimulus "pillow on the bed") 
f stimulus "spread pulled back for the pillow." 
pulled back for the pillow" became a conditioned 
reinforcer for the response immediately preceding it, "pulling the 
spread back for the pillow." And so on. Thus, when backward chain- 
ing is used, the reinforcing power of the positive reinforcer (pre- 
at the end of the chain) is transferred "down the line" to each 
added to the chain. This makes for very efficient use of 


conditione 
"putting the pi 
forced (by the c 
in the presence o 
Therefore "spread 


sented 


S" as it is r 
positive reinforcement to establish a strong chain. 
Backward chaining has also been used in teaching various 


dressing, grooming, and verbal behaviors to retarded individuals. In 
order to teach a boy to put on a pair of slacks, for example, we break 


down the task into the following nine steps: 


taking the slacks from the dresser drawer 
holding the slacks upright with the front 
putting one leg in the slacks 

putting the other leg in the slacks 
pulling the slacks to the knees 

pulling the slacks to the thighs 

pulling the slacks all the way up 

doing up the button or snap 

doing up the zipper 

When we teach an individual this chain, we start with the last step 
a The trainer helps the individual put on the slacks so that all the 


facing away from the individual 


;o0 M OO Ub D r-— 


150 

Basic 
Behavioral 
Principles 

and Procedures 


steps are completed except for step 9. The individual is then taught 
to do up the zipper. When he can do this, he is taught to do up the 
button (step 8), which is the S? for doing up the zipper. When he can 
make both responses, the slacks are pulled down to his thighs. He is 
then taught to pull them all the way up (step 7), which is the S^ for 
the response at step 8. The training proceeds in this backward fash- 
ion, with one step being added at a time, until the individual can 
perform all nine steps. 

An interesting and often useful feature of chaining is that it is 
possible to break down any link into a sequence of smaller stimuli 
and responses. Suppose that an individual has difficulty performing 
step 9 in the above procedure. That step can be made easier if we 
break it down into a chain of its own that can also be taught by the 
method of backward chaining. 

No doubt because backward chaining resembles a reversal of 
the natural order of things, forward chaining is used more often in 
everyday situations outside the behavior modification setting. 
Among the many examples that could be cited, consider the way the 
child is taught to pronounce a multisyllable word such as "milk." He 
is first taught to say "m," then “mi,” then "mil," and finally “milk.” 
However, one of the authors recently taught the same chain in a 
backward fashion to his eighteen-month-old son. The child first 
learned "k," then "Ik," then "ilk," and finally "milk." For relatively 
short chains such as this, we suspect that it doesn't make much dif- 
ference whether forward or backward chaining is used, but for long 
chains we usually prefer the backward method. (Whether we are cor- 
rect on these points has yet to be determined by experimental re- 
search.) 

Another example of backward chaining is teaching answers to 
questions. Martin et al. (1968) taught autistic children to answer the 
question "Where does milk come from?" in the following way. The 
teacher began by pointing to some milk, or a picture of milk, and 
saying, "Where does milk come from? Milk comes from a COW.” 
Since the students had extensive verbal-imitation training, they 
would usually mimic "cow." The teacher immediately reinforced this 
response. Then the teacher faded out the words of the required re- 
sponse over several trials. That is, the teacher said, "Where does milk 
come from? Milk comes from A — —," to which the students gen- 
erally responded, “a cow." The next step was “Where does milk 
come from? Milk comes FROM — —,” to which the students generally 
said, "from a cow." The teacher continued reducing the size of the 
prompt: "Milk comes — —"; “Milk — —." Finally, the only stimulus 
that remained was the question "Where does milk come from?" 

Backward chaining might be used effectively in all sorts of ev- 
eryday situations in which the typical method is forward chaining. 
For example, it would certainly be an easy matter to analyze a golf 
swing in terms of a chain of steps. No doubt, this is already done to 
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some extent: a golf pro is likely to examine how i 

wc end Cr en and stand by the ball, how ae xm -— 
M eene 3 swing, how you begin your downswing how wn 
ei ie id how you follow through. He might also di id a 
c ps into a finer chain. But, would he use back pma 
ing to teach the entire sequence? Probably not. It ih id e [oi 
esting to teach a novice to hit a golf ball by starting with th a 
position at the end of the follow-through and then proc : din ds 
wards one step at a time until the entire sequence s aded mE 


FACTORS INFLUENCING THE EFF 
ECTIVENE 
BACKWARD CHAINING' ns 


1. Identify the components of the final sequence 


The behavioral sequence you wish to d 

into individual Ai, and the en qeu e "s Med 
must be kept. As with the selection of shaping steps Siar ne 
Chapter 4), the selection of chaining steps or components en z 
what subjective. The components should be simple enou ih Pe ud 
learned without great difficulty. If you wanted to teach a eee : 
tarded child to brush her teeth, for example, it would be a salis d 
er the task in terms of the three gross steps of putting acte 
h, brushing, and rinsing. In order for the child to 
each of these steps would have to be subdivided 
The components should also be selected so 
mulus or set of stimuli signaling the com- 
n of each component. This will facilitate the development of 
nditioned reinforcers for preceding responses and 
nt responses throughout the chain. For example 
d chaining to teach a child appropriate hand- 
washing behavior, you might select putting water in the sink as one 
of the components. It would be important to specify a particular level 
of water, and perhaps even make a mark (at least temporarily) ap- 
proximately halfway up the sink, in order to provide a very clear 
stimulus that terminates the end of this particular component (which 
you might define as “holding the water taps until the water level 
reaches the halfway mark"). 


consid 
paste on the brus 
master the chain, 
into even smaller steps. 
that there is a clear-cut sti 
pletio 
those stimuli as co 
as $s for subseque 
in utilizing backwar 


2. Develop each component to a high level before 
proceeding to the next component 
le to make a bed, step 2; the ‘final ‘come 


In the case of teaching Gisel 
ponent, which consisted of pulling the spread over the pillow, was 
ee before Giselle was taught step 19 (and 


developed to 4 high degr 


152 

Basic 
Behavioral 
Principles 

and Procedures 


step 19 was followed immediately by step 20). This is extremely im- 
portant, for two reasons. First, research has indicated that a weak be- 
havioral component in a chain will weaken all of the components 
preceding it. As we suggested earlier, a chain is only as strong as its 
weakest link. Second, it is important that a behavioral component be 
under effective stimulus control of the preceding S". For example, in 
step 20 of teaching Giselle to make a bed, the preceding S^ was the 
appearance of a bed that was completely made except that the spread 
was pulled down from the pillow. Training on step 20 continued un- 
til Giselle/s behavior of pulling the spread over the pillow was under 
very good stimulus control of the preceding S". This means that the 
preceding S" was closely associated (in Giselle's case) with the stim- 
uli provided when bedmaking was completed. In turn, those stimuli 
were closely associated with a terminal reinforcer. This means that 
the preceding S^ will become a more effective conditioned reinforcer 
and will reinforce preceding components. 


3. Always complete the components 
that have been taught 


In every trial during training, the student should be required to com- 
plete all of the components learned previously, in the order in which 
they were taught. This provides more opportunities for pairings of 
preceding stimuli with subsequent stimuli in the chain. The more of- 
ten these pairings occur, the greater the possibility that the stimuli in 
the chain will become, and remain, effective conditioned reinforcers 
and SPs. This requirement also insures that the student always com- 
pletes a trial successfully, since it denies the previously learned com- 
ponents the opportunity to weaken. 


4. When teaching long chains, add supplemental 
reinforcers at various components 


The bedmaking program for Giselle consisted of twenty components. 
Following completion of the entire chain, Giselle received a token. 
Since the procedure was backward chaining, only the stimuli associ- 
ated with the final component were paired with the token. Thus, the 
stimuli provided by the completion of the first component (the com- 
ponent that starts the chain) were never paired with the token. In 
other words, stimuli from early components were never paired with 
the major reinforcer provided for the completion of the chain. Re- 
search has indicated that early components in a chain can be 
strengthened if they are occasionally paired with a major reinforcer 
during the performance of the chain. For example, in the bedmaking 
program for Giselle, step 7, straightening the top sheet, could occa- 


153 
Backward 
Chaining 


sionally lead to a token (as well as providing the stimuli for Giselle to 
perform the next step). Intermittent pairings of each component with 
powerful reinforcers (such as the reinforcer provided for the com- 
pletion of the chain) will help strengthen those components and keep 
them strong. This is especially true of the early components in very 


long chains. 


PITFALLS OF CHAINING: HOW IT WORKS TO THE 
DISADVANTAGE OF THOSE WHO ARE IGNORANT OF IT 


Just as relatively simple undesirable responses are often established 
inadvertently through the thoughtless administration of positive rein- 
forcement, so also are undesirable chains. For example, Steven, a little 
our programs, always used to say "ple-ap" when asked 
to say “apple.” Clearly, the boy had learned to make the correct 
imitative responses for the word, but for some reason or other he had 
chained them together in the wrong order. Once strengthened, this 
inappropriate chain continued to be maintained, because adults in 
Steven’s immediate environment “understood what he meant" and 
ples when he said ^ple-ap." However, incorrect syllable 
chains do not promote optimal verbal development, so we replaced 
this inappropriate chain with the correct one. The teacher first taught 
Steven to imitate "ap" and "ple" separately. Then, using fading, she 
would say very softly, "Steven, say ‘apple.’ " Quickly and loudly, be- 
fore Steven could say "*ple-ap," the teacher said "ap." As soon as he 
said "ap," she said "ple" and reinforced the correct imitation of the 
last syllable. Over trials, the prompt "ap-ple" was gradually softened 
(faded out) and the instruction "Steven, say apple" was gradually 
made louder (faded in). Eventually, Steven correctly imitated the ver- 
bal stimulus "apple" without prompting. 

Probably the most common kind of undesirable chaining occurs 
when an inappropriate response precedes an appropriate response 
that is reinforced; both responses are thereby strengthened together. 
A good example of this type of chaining is the distracting habit ex- 
hibited by some speakers of prefacing each remark with uh. A 
similar though somewhat more serious example is the making of bi- 
zarre facial expressions prior to each utterance. . sear as 

Sometimes, the application of other behavior modification 
es results in accidental undesirable chaining. Here is an ex- 
our experience. A father resolved to change from using 
(spankings) to using positive reinforcement to teach his 
e meaning of “No.” Whenever the boy touched a dan- 
a light plug) or a fragile one (such as the 
“No” in a firm tone. This caused the boy to 
because in the past he had been spanked 


boy in one of 


gave him ap 


procedur 
ample from 
punishment 
infant son th 
gerous object (such as 
stereo), the father said 
stop touching the object ( 


154 

Basic 
Behavioral 
Principles 

and Procedures 


for continuing to do so when his father said "No"), whereupon the 
father immediately rewarded him with praise and hugs. One day, the 
father noticed that the boy had developed a consistent behavior pat- 
tern that one might suspiciously call a "game." It seemed to be 
played in this way: (1) touch an object in view of Dad; (2) if Dad says 
"No," stop touching the object, run to Dad, and get praise and hugs; 
(3) repeat with other objects, and get more praise and hugs. Thus, it 
appeared that the child had acquired the following chain: 


S? — R — S5 — R st 
(Dad's (Child (Dad says (Child stops (Dad gives 
presence.) touches object.) “No.") touching object child praise 


andrunstoDad.) and hugs) 


The father, who happened to be a behavior modifier, was not totally 
unprepared for the development of this undesirable chain and was 
able to change the game appropriately. Can you guess how? 

The self-control problems that plague many people provide sev- 
eral other examples of undesirable behavioral chains. Consider the 
problem of overeating. Although there are undoubtedly a variety of 
possible reasons for overeating, one of the more frequent causes is 
the inadvertent development of undesirable behavioral chains. For 
example, it has been observed that some overweight people eat very 
rapidly.” An examination of the behavioral chains involved suggests 
the following components: loading food on to the utensil, placing 
food in the mouth, reloading utensil while chewing the food, simul- 
taneously swallowing the food while raising the next load of food to 
the mouth, placing food in the mouth, and so forth. This behavioral 
chain has been successfully broken by extending the chain and in- 
troducing delays. A more desirable chain might be the following: 
loading food on to the utensil, placing food in the mouth, putting 
down the utensil, chewing the food, swallowing, waiting three sec- 
onds, reloading the utensil, and so on. In other words, in the unde- 
sirable chain the person gets ready to consume the next mouthful be- 
fore even finishing the present one. A more desirable chain separates 
these components and introduces brief delays. 

Another undesirable behavior chain that is manifested by some 
overweight people consists of watching TV until a commercial comes 
on, going to the kitchen during the commercial, getting a snack, and 
returning to the TV (a very powerful reinforcer in itself). Another ex- 
ample, one that is commonly observed in homemakers who eat ex- 
cessively consists of preparing a snack, taking the snack to the tele- 
phone, calling a neighbor or relative, and eating tHe snack while 
talking on the telephone (again, thereby supplementing the reinforce- 
ment value of the food itself). There are a variety of procedures for 
solving such self-control problems, and these are discussed more 
fully in Chapter 25. The point to remember here is that undesirable 
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Backward ; 
Chaining chains. 


GUIDELINES FOR THE EFFECTIVE U 
SE 
BACKWARD CHAINING? - 


One should observe the following rul i 
response chains. oa WORK 


Identify the units of the chai i 

out reat difficulty by the cede ee iei oie ele d'en ndis 
The units must be taught in the proper sequence. enc um = — 
lus control will develop, in that when one step is comple ty stimu- 
be a discriminative stimulus for the next step but 2 sh 
(as when a young child learns to count been 


T. 
2. 


necessarily 
control some other step 
rectly — for example, 1, 2, 4, 3). 
3. Make sure that a given step has been mastered befo: 
É re you t 
step. Otherwise, the task may be too difficult for the kod oo 
teaching and his behavior may extinguish because of the lack of adipic 


reinforcement. 
4. To expedite learning, 
chain. (See the example: 
tion answering.) 


5. If you are using 
responds he perfor 
point. He should ful 


at the end of the chain. 
6. Make sure that the reinforcement provided at the end of the chain con- 


forms to the guidelines for the effective application of m P 
ment given in Chapter 2. The more effective this ee 
is, the more stable the chain of responses will be. This does not Ae 
however, that once a chain is developed it must be reinforced in he 
be maintained. After Giselle had been taught to make a bed, for exam l5: 
bedmaking could be viewed as a single response, which could, if edid. 

forcement schedule. d 


be put on any intermittent-rein 


use the fading procedure to teach each unit i 
s in this chapter of teaching bedofling and pic 


backward chaining, make sure that each time the student 
ms the entire set of components learned up to that 
fill this requirement in order to receive the reinforcer 


m 


Study Questions 


(for examination purposes) 


i for Giselle divided i 
hy was the bedmaking program into twent 
i Wy not eighteen steps? Why not twenty-two steps? PNIS 


2. What is backward about backward chaining? 
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3. In the bedmaking program with Giselle, what were the criteria for decid- 
ing that a particular component was learned and for introducing a new 
component? 

4. In the training program with Danny (Chapter 8), what were the criteria 
for deciding that a particular step was learned and for moving to the 
next step? Why were the criteria for Danny’s program and Giselle’s pro- 
gram different? 

5. Describe or define a stimulus-response chain, and give an example other 
than the examples in this chapter. 

6. Why do you suppose a behavioral chain is called a chain? 

7. In a chain, a given stimulus is both an SP and a conditioned reinforcer. 
How can this be? (Explain with an example.) 

8. What is a problem encountered in forward chaining that is not encoun- 
tered in backward chaining? (Hint: The problem involves the terminal 
reinforcer.) 

9. In the behavioral chain of driving a car, accelerating it, and changing 
gears (assume that you have a four-speed transmission), how is the 
chain of the driver who has a tachometer (and uses it) different from the 
chain of the driver who does not have a tachometer? 

10. What are two major differences between chaining and shaping? 

11. In what major respect are fading and chaining different, and in what ma- 
jor respect are they similar? 

12. What are the details of the backward chain Nickie developed when 
token-training Johnny (Chapter 9)? 

13. naen learning poetry, individuals frequently have more problems remem- 

ering a new line after completing an earlier line than remembering the 


words in a particular line. Why do you suppose this is? (Hint: Examine 
the factors influencing the effectiveness of chaining.) 


Study Exercises 


(to be practiced by the reader) 


1. Describe how you might use backward chaining to teach a child to lace 
his shoes. 


D. e gu how you might use backward chaining to teach a child to tie a 
not. 


3 oe how you might use backward chaining to teach a child to tie a 
ow. 


4. Try out your programs in the above three questions and see how they work. 


Self-Modification Exercise 


(to be practiced by the reader) 


Identify a behavioral deficiency of yours that might b 
ward-chaining procedure. Describe in detail ae ee ae s a c i 
lines for the effective use of backward chaining to overcome this aa 
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^ chains can be seen in a paper 


There has been very little applied research on the variety of factors 
that might be important in the development and use of chaining with 
humans. However, there has been a good deal of basic research on fac- 
tors influencing the development and maintenance of chains of behav- 
ior in lower organisms (see Kelleher and Gollub, 1962; Kelleher, 1966). 
The suggestions made in our discussion of the factors influencing the 
effectiveness of backward chaining have been abstracted primarily from 


basic research studies. 


An excellent analysis of behavior principles, including chaining, that 
are involved in the problem of overeating was made by Ferster, Nurn- 
berger, and Levitt (1962). However, the "eating styles" of obese individ- 
uals has not received extensive attention from researchers. Interested 
readers should consult an excellent report by Mahoney (1975), who 
stresses the importance of recognizing some of the unexamined as- 
sumptions of the behavior modification approaches to weight control. 


: Although we have emphasized backward chaining in this chapter, 
there are actually three main strategies for developing a behavioral chain: 
backward chaining, forward chaining, and total task presentation. For- 
ward chaining proceeds in a fashion opposite to that of backward chain- 
ing. For example, in a 20-step training program, the teacher would rein- 
force the student for performing step 1 to some satisfactory mastery 
criterion; then for performing steps 1 and 2 to criterion; then steps 1, 2, 
and 3, and so on, until all 20 steps in the chain were mastered. In the total 
task presentation strategy, a student is prompted through all of the steps 
in a chain on each trial. In a 20-step training program, this student would 
be taught and helped to perform all 20 steps on each trial. As his perform- 
ance improved on the steps, help would be gradually eliminated. (Also, 
see the example on p. 125 concerning teaching a child to imitate "cat"). 


Examples of the application of all three strategies to develop behavioral 
by Martin, Kehoe, Bird, Jensen, and Dar- 


byshire (1971). 
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Transferring 
A Behavior 


From One Setting 
to Another Through 


GENERALIZATION 


"Let's improve our posture" 


SANDRA, SARAH, SIGRID, AND SUSAN 
LEARN GOOD POSTURE 


Many severely and Profoundly retarded individuals are rather conspicuous 
in public because of their bizarre walking, Standing, and Sitting postures. 
Whether due to biological defects, early-childhood deprivation and injury, 
or inadvertent reinforcement by the attention they tend to evoke, such bi- 
zarre postures clearly are not advantageous. First 


"look funny." Posture is, of 
It might be desirable to 
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change society's negative attitude tow: i 
until this can be done, it would be Eur m E but 
as "normal" as possible in the eyes of the public These ii Vd 
ready have enough social prejudice against Ho iihaut u Made a: 
creed - it d their manner of carrying themselves NUN 
ese considerations led psycholo ra i 
to set up a special classroom for the Hie bec nap ngs nd 
Cottage, a residence for severely and profoundly retarded siiis geen 
The Manitoba School.* Because the class was set up on an ki eaten 
basis, only four residents—the ones showing the very worst evel 
were chosen to participate in it. Their names, for the purpose SE viguit 
port, were Sandra, Sarah, Sigrid, and Susan. All were profound! ons 
Their chronological ages ranged from 22 to 25, and their aA Wine 
ranged from "unmeasurable" to 2 years. Only sitting esed eR om 
worked on in this early stage of the experiment. DAMES 
Rae knew that by using behavior modification 

probably not find it too difficult to establish good BPA or Lue 
mental classroom. But she also realized that it would be pointless to ied 
this new behavior if it did not subsequently occur more readily in other M 
uations as a result of the classroom training. Therefore, she selected t i 
other situations—the day hall and the dining room—in which to test ra 
improvement in posture that would be attributable to the posture tuni 
being given in the classroom. She also decided that should these tests m 
dicate that the behavior did not generalize satisfactorily across situations 
she would attempt to discover how such generalization could be TR 
creased. 

The classroom contained four chairs for the residents, which were 
arranged in a semicircle around the teacher's chair. A board for holding 
small pegs was attached to one side of each resident's chair. Just prior to 
the study, the residents were trained to accept pegs as token reinforcers 
that could later be exchanged for desired items such as candy, cookies 


and Coke. 
essions were conducted each weekday, one in the 


Two classroom si 
morning and one in the afternoon. Each session lasted for thirty minutes 


Alternating trials among the residents, Rae modeled the correct posture 
and verbally instructed the resident whose turn it was. A red stimulus light 
was switched on as soon as the resident showed the correct behavior. The 
light remained on until a required duration of engaging in the behavior 
had elapsed, and reinforcement was then presented. An incorrect trial— 
one in which the resident did not engage in the behavior within a given 
time period or did not engage in it long enough —led to a sharp "No!" 
from Rae, who then turned off the light if it had been on. Rae used shap- 
ing, fading, and other standard procedures, and obtained a high level of 
correct performance. 

ted to an observation room by a one-way 


The classroom was connec 
window. There, two observers kept accurate records of the sitting posture 
of each resident during trials and between trials. 

Over a number of sessions, all of the residents eventually reached 
100-percent-correct trial performance. Rae then began intermittently rein- 
*This case study is based on Lowther, Martin, and Nicholson (1977). 
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forcing good posture between trials while continuing the above procedure 
during trials. About twenty-five days after the beginning of training, all of 
the residents were still showing 100-percent-correct performance during 
trials. Moreover, Sandra, Sigrid, and Susan were showing good posture 
between trials. Sarah was showing good posture about 70-percent of the 
time between trials. 

Observers then began systematically recording the four students’ 
postures in the day hall and the dining room before and after each class- 
room session. They found that very little or no generalization occurred 
from the classroom to these other settings. Posture in the day hall and 
dining room was terrible, even though it was excellent in the classroom. 
Rae attempted to find out exactly what she had to do in order to obtain 
satisfactory generalization. 

The first thing she tried was simply entering the day hall and mod- 
eling good posture while sitting in one of the chairs. She did this for fif- 
teen minutes twice a day—just before and just after classroom sessions— 
for six days. All four residents showed immediate improvement in the day 
hall, but this improvement was temporary for all but Sandra, who contin- 
ued to perform well even when Rae was not in the day hall. In the dining 
room, virtually no improvement occurred with any of the four residents. 

Since satisfactory generalization was temporary for all but Sandra, 
Rae turned to another tactic. Prior to each classroom session, she mod- 
eled the desired posture and also delivered verbal instructions and social 
reinforcement in the day hall. Moreover, she presented reinforcement on 
VI schedules at other times throughout the day when the residents were in 
the day hall. In order to do this, Rae constructed five VI schedules, rang- 
ing from VI 15 minutes to VI 35 minutes. Each day, Rae drew one of these 
at random, entered the day hall according to schedule, and reinforced the 
four residents’ good posture with smiles, praise, Coversation, and physical 
contact. She ignored poor posture. Sandra, Sigrid, and Susan showed im- 
mediate, large, and lasting improvement in the day hall. In addition, their 
posture improved in the dining room (although to a lesser extent), even 
though Rae was never present in that Setting! Sarah, however, who had 
shown the poorest improvement all along, showed a little improvement in 
the day hall and none in the dining room. Nevertheless, Rae was very en- 
couraged that the experimental Program had proved so successful for 
three of the four residents on whom it was tried. The generalization data 
for Susan (who was representative of the three successes) and Sarah, 
whose posture improved only a little, are shown in Figure 11-1. 

The general success of the program was that Sandra, Sigrid, and Su- 
san maintained good posture in numerous situations after their formal 
training was concluded. They held their heads up on most occasions and 
readily made eye contact with anyone who approached them. They 
slouched and sprawled very infrequently. Staff members were instructed to 
continue to reinforce good posture as often as possible. 

Considering that the four residents had sh 
ture — because of biological defects, early child 
jury, and many years of nothing more than custodial care—and consid- 
ering that they were so profoundly retarded, Rae's experimental posture- 
training program appears to have been very successful overall. It seems, 
moreover. that such a program could be appli i 


own the very worst pos- 
hood deprivation and in- 


ed advantageously to many 
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Dining Room 


eee = 42 12 — ted 
EXPERIMENTAL DAYS 
izatii fect posture of Susan and 
-1. Summary generalization data of peri : ture 
ii api MN in the dining room, during the inter-trial intervals in the 
ara the pretests and posttests in the day room. Adapted 


oom, and during ) 
Pan Casta Martin, and Nicholson (1977). 
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residents. But although the amount of generalization ultimately obtained 
was quite satisfactory on the whole, the study showed that this result is 
not something that can be taken for granted. Rather, generalization must 
be carefully built into any program for which success is important enough 
not to be left to chance. 


GENERALIZATION 


When establishing a behavior in the presence of a particular stimulus 
or situation causes the behavior to occur more readily in the presence 
of another stimulus or situation, we say that the behavior has gen- 
eralized from the first to the second stimulus or situation. Stimulus 
generalization occurs when behavior becomes more probable in the 
presence of one stimulus or situation as a result of having been 
strengthened in the presence of another stimulus or situation. In the 
above study, for example, Rae Lowther was concerned with the gen- 
eralization of good posture from the classroom situation to the day 
hall and the dining room. 

Generalization is the opposite of discrimination. As explained 
in Chapter 7, when a behavior occurs in the presence of one stimulus 
or situation more readily than in the presence of another, we say that 
the individual has discriminated between the two stimuli or situ- 
ations. The four residents in the above study, for example, initially 
discriminated between situation 1—the classroom — and situations 2 
and 3— the day hall and the dining room in that their postures were 
excellent in situation 1 and terrible in situations 2 and 3s 

There are many examples of generalization in everyday life. 
Consider a case that is familiar to many parents: An infant learns to 
say "doggie" to a hairy, four-legged creature with floppy ears and a 
friendly bark. Later, the infant sees a different kind of dog and says 
“doggie.” This is an instance of generalization because a previously 
reinforced response (“doggie”) was emitted in the presence of a 
new stimulus (a new kind of dog). Still later, the infant sees a horse 
and again says "doggie." This is another instance of generalization, 
even though the response in this case is incorrect— proving that not 
all instances of generalization are favorable and illustrating why it is 
necessary to teach discriminations, as described in Chapter 7. 

Looking back through the Previous chapters, one can see that 
generalization is an important consideration in 
gram. For example, it was desirable for Charles (Chapter 2) to take 
his pills from nurses other than Ms. Peabody. Likewise, it was desir- 
able for Peter (Chapter 3) to decrease his tantruming in situations 
other than the classroom. Unfortunately, Peter failed to generalize 
and continued to tantrum when back on the ward. These and similar 


every training pro- 
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examples illustrate that failure to obtain generalization is a major 
problem facing behavior modifiers. How do we solve the nodu 

Before answering that question, we must make it clear that there 
are two levels of generalization to be concerned with in any trainin 
program. One is generalization to different stimuli within a un 
training program. An example of this is teaching a child to say "dog" 
to different pictures of dogs, "horse" to different pictures of horses 
and so on. The child in this example is being taught to generalize me 
response “dog” to many different members of the stimulus class 
“dog,” to generalize the response “horse” to many different members 
of the stimulus class “horse,” and so forth. Incidentally, note that the 
child is also being taught to discriminate between stimulus classes so 
that he will not say “dog” when the stimulus is a horse, or “horse” 
when it is a dog.' 

The second level of generalization to be concerned with is gen- 

eralization from the training situation to the natural environment. 
Continuing with the above example, this level of generalization 
would be demonstrated if the child correctly identified dogs and 
horses whenever he saw them outside of the training situation. 
The first level of generalization is relatively easy to obtain: just 
reinforce the response in the presence of different members of the 
stimulus class to which you want the response to generalize (while, 
of course, extinguishing the response to inappropriate stimuli). But 
the second level of generalization usually poses quite a problem. Not 
that it is especially difficult to obtain temporary generalization: just 
make the training situation very similar to the natural environment. 
The problem is to obtain long-lasting generalization.? As we have 
seen, if the behavior is not reinforced in the natural environment, the 
sh in that situation. That is, the individual 
might discriminate between the training situation and the natural en- 
vironment. It is therefore very important that the behavior modifier 
ider the following factors when programming for generalization. 


behavior might extingui 


cons 


FACTORS INFLUENCING THE EFFECTIVENESS 
OF GENERALIZATION 


1. The similarity between the training and test 


situations 


1 occurrence of generalization depends critically on the 
en two stimuli or situations. The more sim- 


tial generalization (and hence the less dis- 
en them. In Rae Lowther’s study, 
] similarity between the classroom 
there was little physical sim- 


The initia 
physical similarity betwe 
ilar they are, the more ini 
crimination) there will be betwe 
there apparently was little physica 
and the day-hall situations. That is, 
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ilarity until the teacher entered the day hall and modeled the correct 
posture. This made the day-hall situation similar to the classroom sit- 
uation, and generalization between the two situations therefore oc- 
curred (even though this generalization was only temporary). 

Thus, the first effort of the behavior modifier attempting to pro- 
gram generalization should be to make the final stages of the training 
situation similar to the test situation in as many ways as possible. 
(By "test situation," we mean either the natural environment or some 
other situation to which we want generalization to occur.) Other 
things being equal, the best way to do this is to train in the test situ- 
ation. 


2. The reinforcement contingencies in the test 
situation 


Besides physical similarity, generalization from one stimulus or situ- 
ation to another (if it is to be long-lasting) depends critically on 
whether the behavior will be reinforced in the presence of the second 
stimulus or situation. Initially, when Rae Lowther entered the day 
hall she did not reinforce good posture in that situation. Recall from 
Chapter 7 that reinforcing a behavior in the presence of a particular 
stimulus or situation and not reinforcing it in the presence of another 
is the method for establishing a discrimination between the two 
stimuli or situations. This explains why generalization of good pos- 
ture from the classroom to the day hall was only temporary for Sigrid 
and Susan when the teacher merely modeled good posture in the day 
hall. To obtain long-lasting generalization from the classroom to the 
day hall, Rae had to reinforce the behavior in the latter as well as the 
former situation. 

But why, you will probably ask, did Sandra— unlike the other 
three residents show strong and long-lasting generalization to the 
day hall when good posture was not reinforced in that situation, and, 
indeed, even when the teacher was not present there? We have to ad- 
mit that in the present state of knowledge of behavioral psychology, 
we cannot answer that question adequately. Of course, we can make 
some educated guesses. Perhaps Sandra had an ankron source of 
reinforcement for good posture. Or perhaps for Sandra good posture, 
once it had been “reinforcer sampled,” was “self-reinforcing” (that 
is, no external reinforcement was required to maintain it) Ür per- 
haps, as a last-resort explanation, Sandra simply had more "of an in- 
nate (that is, inborn) tendency to generalize than did the other three 
residents.” But these guesses are of little importance. The important 
point, to reiterate, is that reinforcing a behavior in a situation outside 


the original training situation will maintain the generalization to that 
second situation. 
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Although Rae was able to generalize good posture by rein- 
forcing it in the day hall, it is obvious that this solution would be 
impractical in many situations. No behavior modifier could follow all 
her students around and reinforce the target behaviors everywhere it 
was desirable for them to occur. It would be a full-time job to do this 
for just one individual. Short of this extremely impractical measure, 
there are four general approaches to the problem of achieving lasting 
generalization by managing contingencies in the test situation. 


a. NATURAL CONTINGENCIES OF REINFORCEMENT. The first approach is 
to make use of the reinforcement the natural environment already 
provides for the target behavior. In most cases, such contingencies 
are probably operating at least to a minimal extent; otherwise, the 
target behavior would probably be useless to your student and there- 
fore not worth establishing. 

Talking is an obvious example of behavior that is heavily rein- 
forced in most natural environments. Yet a child may not learn to talk 
because of what are, at least for him, deficient shaping contingencies 
in his environment. Nevertheless, after speech has been established 
in a training situation, it continues unabated in the natural environ- 
ment because of the natural contingencies of reinforcement for it 
there. Indeed, it sometimes seems necessary only to establish vocal 
imitation and a few object naming responses in order for the natural 


contingencies of reinforcement to take over and develop very func- 


tional speech behavior. 
Many fears can be overcome permanently if the natural contin- 
gencies are allowed to take over after the individual has been gradu- 
ally induced to engage in the previously feared activity. Such activi- 
ties often provide their own sources of reinforcement once they are 
no longer feared. For example, playing with other children is a be- 
havior that might gradually be shaped in a very shy child. Once this 
behavior is strongly established, however, the behavior modifier 
probably will not have to worry about reinforcing it further. The 
other children will take care of that themselves in the course of their 
play, for, indeed, that is what social play is all about. 
This approach to the problem of lasting generalization has been 
lled trapping, because it involves developing behavior that in a 
a "behavioral trap" represented by the contin- 


falls into the 
canis in the natural environment (Baer and Wolf, 1970). The ap- 
E ul requires the behavior modifier to carefully tailor the target be- 
P 


ior to fit these contingencies after he or she has realistically 
havior d them. For example, the behavior modifier should gradually 
get behavior to an intermittent schedule that provides 
E ment less frequently than does the natural environment. It 
reinforce nwise to expect the target behavior to survive the transi- 
bie d frequent reinforcement at the same time that it is making 
tion 


appraise 
adjust the ta 
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the transition to a physically less similar situation. On the other 
hand, a transition to more frequent reinforcement will help overcome 
the tendency of the individual to discriminate between the natural 
environment and the training situation. (An example of behavioral 
trapping is shown in Figure 11-2.) 


b. CHANGING THE PEOPLE IN THE NATURAL ENVIRONMENT. A second 
approach to the problem of achieving lasting generalization is usually 
more difficult than the first. It involves actually changing the contin- 
gencies in the natural environment so that they will maintain the be- 
havior established in the training situation. This is illustrated in the 
case study at the beginning of this chapter, in which the staff mem- 
bers were instructed to reinforce good posture in the day hall in or- 
der to help effect generalization to that situation. Later, the staff 
members were instructed to reinforce good posture in many other 
natural settings as well. 

In following this second approach, it is necessary to work with 
people in the natural environment—ward staff, parents, teachers, 
neighbors, and others who have contact with the target behavior. The 
behavior modifier must teach these individuals how to appropriately 
reinforce the behavior (if it is desirable) or how to extinguish it (if it 
is undesirable). The behavior modifier must also occasionally rein- 
force the appropriate behavior of these individuals—at least until it 
comes into contact with the improved target behavior, which will 
then, ideally, reinforce their continued application of the appropriate 
procedures. 

As an example of this second approach, consider the case of a 
child living at home who has little behavior in her repertoire except 
tantruming. Possibly this is her sole means of gaining attention and 
other reinforcers from her parents. There is little doubt that more de- 
sirable behaviors could be established in a training situation, but 
such behaviors would not be maintained in the home situation un- 
less the contingencies operating there were changed. A behavior 
modifier called in on this case might therefore adopt the following 
plan. 

In a training situation designed to teach the child to play with 
toys rather than tantrum, he would first adjust the desired behav- 
ior to an appropriate schedule— for instance, VI/LH with infrequent 
reinforcement (since it will not be practical for the parents to give 
frequent reinforcement in the home environment). Having accom- 
plished this, the behavior modifier would begin generalization train- 
ing in the home environment. 

The behavior modifier would show the mother how to keep ac- 
curate records of the child's desirable and undesirable behavior. At 
first, the mother, with the help and prompting of the behavior modi- 
fier, would frequently reinforce the child for playing nicely with her 
toys in the living room. Gradually, she would decrease the frequency 
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of reinforcement in order to have more time for activities that did not 
involve the child. She would use a kitchen timer, or similar device, to 
remind herself to reinforce the child. Throughout this procedure, the 
behavior modifier would frequently reinforce the mother for appro- 
priately managing and recording the child’s behavior. Then he would 
quickly fade out of the situation by visiting less and less frequently 
to check the mother’s records. (But he would not fade out too fast; if 
the program deteriorated, he would temporarily stop the fading pro- 
cess and spend enough time in the training situation to correct mat- 


MAYBE WE SHOULD SHAPE 
CHARLIE'S SOCIAL SKILLS. 


THATS IT, CHARLIE, 
YOU'RE DOING GREAT. 


MAYBE WE SHOULD STOP 
REINFORCING CHARLIE NOW ? 


FIGURE 11-2. An example of behavioral trapping. 
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ters.) Ideally, the mother’s behavior of appropriately reinforcing the 
target behavior would eventually be maintained by the child’s good 
play behavior and her decreased whining, crying, and tantruming.? 


c. USING SCHEDULES OF REINFORCEMENT IN THE TEST SITUATION. In 
some test situations, it is possible to utilize schedules of reinforce- 
ment in such a way that the generalized behavior can be maintained 
for long periods of time. Consider an interesting study by Kale, Kaye, 
Whelan, and Hopkins (1968). These authors first used prompting and 
fading to teach three schizophrenic patients in a mental hospital how 
to appropriately greet staff members whom they encountered on the 
ward. Whenever the patients greeted a staff member correctly, the 
staff member responded and provided a good deal of praise along 
with cigarette reinforcers. When the greeting responses were well es- 
tablished, the schedule of reinforcement was gradually changed over 
several weeks to a variable-ratio schedule (for one of the patients, the 
schedule was as high as a VR 20). Next, the patients were reinforced 
only with praise for greeting the staff appropriately: they were not 
supplied with cigarette reinforcers. However, the greeting response 
did not generalize to a second staff member until the training proce- 
dure was repeated with five new staff members. The program then 
produced persistent greeting behavior (at least toward the first two of 
the staff members), which was maintained during a three-month fol- 
low-up. Although no additional follow-up data were recorded, the re 


sults imply that proper use of schedules of reinforcement might help 
bring about generalization. 


d. GIVING THE CONTROL TO THE INDIVIDUAL. In recent years, a rapidly 
growing area within behavior modification has been concerned with 
helping individuals (primarily adults) to apply behavior modification 
to themselves. This area, which has been referred to as self-manage- 
ment, self-modification, and behavioral self-control, has produced 
several books containing easy-to-follow "'how-to-do-it" procedures 
that help individuals manage their own behavior. (This area is dis- 
cussed more fully in Chapter 25.) It seems clear that individuals can 
rearrange their environment in order to change their behavior, and in 
general develop good self-control. 


3. The number of training situations in which the 
behavior was reinforced 


A third factor influencing generalization to a new stimulus or situ- 
ation is the number of other stimuli or situations in the presence of 
which the behavior has been reinforced during training. In the study 
conducted by Rae Lowther, when good posture was reinforced only 
in the classroom, none of the four residents showed any general- 
ization to the dining room. But when good posture was reinforced 
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both in the classroom and in the day hall, three of them generalized 
to the dining room, even though good posture was not explicitly re- 
inforced in that situation. Of course, when good posture was later 
reinforced in the dining room, generalization to that situation be- 


came even stronger. 


PITFALLS OF GENERALIZATION: HOW IT WORKS TO THE 
DISADVANTAGE OF THOSE WHO ARE IGNORANT OF IT 


Without generalization, learning would be of very limited value. No 
matter how perfectly a person learned something, he would have to 
learn it all over again every time the situation changed even slightly. 
(Just imagine how annoying it would be to have spent much time 
learning a skill only to discover that you no longer possessed it after 
moving to a new city to begin a job that depended on that skill.) But 
generalization has its disadvantages too, in that a behavior learned in 
a situation in which it is appropriate may then emerge inconven- 
iently in a situation in which it is inappropriate. 

A conspicuous example of this problem among retarded indi- 
viduals lies in the area of greetings and displays of affection. Of 
, it is highly desirable for these behaviors to occur under ap- 
ces, but when an individual walks up to and 
hugs a total stranger, the result can be less than favorable for a num- 
ber of obvious reasons. The solution to this problem is to teach the 
individual to discriminate between situations in which different 
forms of greetings and expressions of affection are appropriate and 
situations in which they are inappropriate. 

The opposite type of problem should also be noted. For ex- 
ample, the suppression through punishment of displays of affection 
may cause an individual to be cold and withdrawn in situations that 
warrant affectionate behavior. Perhaps this sort of generalization is at 
the root of certain so-called emotional disturbances. Again, the solu- 
tion is to teach the individual when and how to express emotional 
behavior such as affection, as well as when not to do so. 

le of inappropriate generalization may be the de- 


Another examp 
structive competitiveness demonstrated frequently by some individ- 


uals and occasionally by all of us. Such behavior may stem in part 
from the strong reinforcement given in our culture for winning in 
sports and in achieving high grades in our educational system. As a 
wise person once remarked, “It may be true that wars have been won 
on the playing fields of Eton, but they have also been started there." 
Another example of the failure to recognize the factors con- 
trolling generalization is seen in the typical study habits of students. 
Frequently, students cram for exams the night before the exam- 
ination. They memorize certain verbal chains in response to certain 


course 
propriate circumstan 
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prompts and questions. What they frequently fail to consider is the 
importance of bringing their knowledge of the material under 
broader stimulus control than just one or two questions, that is, they 
do not program for generalization. A great many people have had the 
same experience with learning a second language. One of the authors 
was among the many who took a second language during four years 
of high school. At the end of that time, he was clearly incapable of 
speaking the language. He had a certain repertoire for answering 
questions on French exams, translating English articles into French, 
and translating French articles into English, but this repertoire had 
not been brought under the stimulus control of a typical conversa- 
tional setting. 

Another pitfall of generalization occurs in the interaction between 
parents and their children. In various social situations, such as res- 
taurants, parents frequently do not present the same stimuli to their 
children, or provide the same contingencies of reinforcement, that 
they present at mealtimes in the home situation. Consequently, the 
children frequently do not generalize their table manners and good 
behaviors that occur at home to the restaurant or other social set- 
tings. It is not uncommon to hear the parents lament, "I thought I 
taught you how to be a good child, and now look at you." We hope 
that after reading this book and performing the study questions and 
study exercises, the same parents will do a much better job of pro- 
gramming generalization. (If not, you will probably hear us lament, 
"I thought I taught you how to be a good behavior modifier, and 
now look at you."^) 


GUIDELINES FOR EFFECTIVE GENERALIZATION 
PROGRAMMING 


To ensure strong and lasting generalization from the training situ- 
ation to the natural environment, the behavior modifier should ob- 
serve the following rules as closely as possible.? 


1. Choose target behaviors that are clearly useful to the individual, as these 
are the behaviors that are most likely to be reinforced in the natural envi- 
ronment. 

2. Teach the target behavior in a situation that is as similar as possible to 
the natural environment in which you want the behavior to occur. 

3. Establish the target behavior successively in as many situations as is fea- 
sible, starting with the easiest and Progressing to the most difficult. 

4. Gradually reduce the frequency of reinforcement in the training situation 
until it is less than that occurring in the natural environment. 
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When changing to a new situation, increase the frequency of reinforce- 
ment in order to offset the tendency of the individual to discriminate the 
new situation from the previous training situation. 

Make sure that sufficient reinforcement for maintaining the target behav- 
ior occurs in the natural environment. This rule requires especially close 
attention in the early stages of transferring the target behavior from the 
training situation to the natural environment. Add reinforcement as nec- 
essary, including reinforcement to those people (such as parents and 
teachers) who are responsible for maintaining the target behavior in the 
natural environment, and then fade out this reinforcement slowly enough 
to prevent the target behavior from deteriorating. 


Study Questions 


(for examination purposes) 


10. 
11. 


Briefly describe the main conclusions to be drawn from Rae Lowther's 


study on generalization. 
In some cases, letting people "do their own thing" can have unpleasant 


i consequences. How is this exemplified in the case of Sandra, Sarah, 


Sigrid, and Susan? 

What was the training situation and what were the test situations with 
Sandra and the other girls? (One word for each is all that we're con- 
cerned with.) 

Why is it that Rae could be quite confident that her reprimand “No” was 
not a reinforcer for Sarah and the other girls? 

What was the tactic that Rae applied unsuccessfully in the day hall in 
trying to produce generalization? What tactic did she try that worked? 
Would it have been easier to remember the girl who showed the poorest 
posture generalization if her name had been, say, Judy instead of Sarah? 
(Hint: Explain on the basis of stimuli controlling your generalization.) 
Carefully explain the difference between stimulus generalization and 
stimulus discrimination. 

In a sentence each, describe three main factors influencing the effec- 
tiveness of generalization. 

In a sentence each, describe four main types of reinforcement contin- 


‘ gencies that will influence generalization in the test situation. 


What do we mean by behavioral trapping? 
Did Kale et al. utilize schedules of reinforcement in the training situation 
or the test situation in order to improve generalization? 


12. Describe two examples of pitfalls of generalization. 
13. Describe two examples of pitfalls of generalization that are not discussed 
in the text. 


Study Exercises 


(to be practiced by the reader) 


1. Describe a recent situation in which you generalized in desirable ways. 

Clearly identify the behavior, the training situation, and the test situation. 

Describe a recent situation in which you generalized in an undesirable 

way (in other words, the outcome was undesirable). Again, identify the 

behavior, training situation, and test situation. 

3. Choose one of the cases described in the previous chapters in which there 
was no effort to program generalization. Outline a specific plausible pro- 
gram for producing generalization in that case, taking into account the 
factors influencing the effectiveness of generalization training. 
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(to be practiced by the reader) 


Consider the behavior deficiency for which you outlined a shaping program 
at the end of Chapter 4. Assuming that your shaping program will be suc- 
cessful, discuss what you might do to program long-lasting generalization. 
(See the factors influencing the effectiveness of generalization that were dis- 
cussed earlier in this chapter.) 


A stimulus class is a set of stimuli, all of which have some character- 
istic in common. For example, look around the room you are in and list 
the objects you see that are red. These objects constitute the stimulus 
class that we might label “red objects.” Although these objects are dif- 
ferent in many respects, they all have in common the color red (defined 
physically in terms of a particular wavelength). When an individual can- 
appropriately identify all red objects, we say that that individual has the 
concept “red.” Stated differently, if an individual emits an appropriate 
response to all of the members of a particular stimulus class, and does 
not emit that response to stimuli that do not belong to the class (for in- 
stance, in the example above the individual does not include green ob- 
jects, blue objects, etc.), then the individual generalizes to all of the 
members within a stimulus class (or concept), and discriminates be- 
(Continued) 
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tween stimulus classes (for instance, between all red objects and all 
blue objects), and we say that the individual is showing conceptual be- 
havior (Keller and Schoenfeld, 1950, p. 155). For a more detailed dis- 
cussion of conceptual behavior, see Whaley and Malott (1971, pp. 
171—192). 


Baer, Wolf, and Risley (1968) described some dimensions of applied 
behavior analysis. One of the dimensions they discussed was generality. 
They suggested, “A behavioral change may be said to have generality if 
it proves durable over time, if it appears in a wide variety of possible 
environments, or if it spreads to a wide variety of related behaviors" 
(p. 96). The first two types of generality mentioned in the above quota- 
tion are what we have described as lasting generalization. The third 
type of generality, behavior spreading to a wide variety of related be- 
haviors, is sometimes called response generalization. It would take 
place if, for example, improvement of articulation of specific words in a 
clinical setting led to improvement in the articulation of other untreated 
words. This type of behavioral effect has been referred to as an "ava- 
lanche" effect by Patterson, McNeal, Hawkins, and Phelps (1967), and 
as those authors suggest, little is known about such effects. The spread 
of improvements to related behaviors may be caused by a complex set 
of events. For example, Patterson et al. described a reinforcement pro- 
gram that improved the behavior of a child in a classroom situation. As 
a result, the child became much less obnoxious to his peers, and his in- 
teraction with the peer group occurred much more frequently. This in- 
teraction, in turn, appeared to result in the strengthening of a large 
number of socially adaptive behaviors. Perhaps because of the com- 
plexity of response generalization, perhaps because the desirable target 
behaviors are usually incorporated into the program design, and per- 
haps for other reasons, behavior modifiers have tended not to describe 
detailed procedures for developing response generality (Keeley, Shem- 
burg, and Carbonell, 1976). 


It is often mistakenly thought that behaviorists do not believe that indi- 
vidual differences in behavior can be due to genetic factors. Actually, 
the behavioristic position is generally that such explanations should be 
proposed only as à “last resort," in the sense that the job of the scien- 
tific psychologist is first to thoroughly check out possible environ- 
mental explanations before saying something like, "Well, the reason 
this individual behaves differently from others must be genetic." The 
noted behaviorist Murray Sidman expressed this position quite clearly 
when he observed that there is little point in investigating presumed ge- 
netic causes of behavioral differences as long as "psychologists are not 
yet capable of stating unequivocally whether or not the variability [i.e., 
differences between individuals] in their data stems from inadequate 
experimental control, insufficient understanding of the [behavioral] pro- 
cesses involved, or from factors [e.g., genetic] that lie outside their 
sphere of competence" (1960, p. 180). 

Martin (1972) discussed the importance of reintorcing the behavior 
of the behavior modifier. Psychiatric nurses and nursing attendants who 
used behavior modification procedures to improve the behavior of re- 
tarded individuals did so much more consistently when their own be- 
havior was reinforced in a structured staff-incentive program. For a 
more recent discussion of factors important in maintaining staff behav- 
iors in residential treatment programs, see Mclnnis (1976). 


(Continued) 
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For a review of programs in which parents have been taught the use 
of behavior modification to manage the behavior of their children in the 
home, see O'Dell (1974). 


Another example of this factor was reported by Stokes, Baer, and 
Jackson (1974). They utilized prompting and shaping techniques to 
teach four institutionalized retarded children to greet the teacher with a 
hand-waving response. After training had been completed by one 
teacher, the greeting response did not generalize when the children 
were approached by any one of the twenty other institutional staff 
members. However, three of the four children showed high levels of 
generalization to other staff members after receiving additional training 
from a second teacher. The fourth child, who did not receive training 
from the second teacher, nevertheless showed generalization of hand 
waving after receiving additional training from the first teacher. 


For a thorough review of the current technology of generalization see 
Stokes and Baer (1977). 


Study Questions on Notes 


What do we mean by "stimulus class"? By "conceptual behavior"? 
Describe how you might teach the concept wet to a child. 

Describe how you might teach the concept honesty to a child. 

Is love a concept? Explain your answer in behavioral terms. 

5. How will the authors judge whether or not you are showing appro- 
priate conceptual behavior in response to the stimulus class positive re- 
inforcer? 

6. wnat are the three types of generality discussed by Baer, Risley, and 
Wolf? 

7. How is a behavioral "avalanche" different from a behavioral ‘“‘trap’’? 
8. ‘Genetic explanations for behavioral deficiencies should be pro- 
posed only as a ‘last resort.’ ” Briefly discuss. 

9. Which factor influencing the effectiveness of generalization is ex- 
emplified by Stokes et al.? 


TANE 
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Eliminating 
Inappropriate Behavior 


Through PUNISHMENT 
and Positive 
Reinforcement 


“James, don’t hurt yourself” 


ELIMINATING JAMES'S SELF-ABUSE 


James was a seven-year-old institutionalized hydrocephalic retarded boy.* 
He had a moderate understanding of speech, and he could follow a few 
simple instructions. His was a very pathetic case, however, for he had to 
spend most of his waking hours strapped in a specially constructed chair- 


table arrangement. 
The reason for t 

chronic head banger. Onl 

was on a soft surface SUC 


his degrading confinement was that James was a 
y if he was holding on to the hand of an adult, or 
h as grass or a carpet, was it safe to allow him 


*This report is based on an unpublished case study by Pauline Kaprowy and Joseph 
Pear at the St. Amant Centre, an institution for retarded children in Winnipeg Mani- 


toba. 
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out of his chair. If the adult released his hand while he was standing on a 
hard surface, James would immediately "dive" to the floor and begin 
banging his head. Unless stopped, he would continue until he was bleed- 
ing profusely. 

We have already discussed how this behavior had most likely been 
reinforced by the attention it evoked from adults; attention was a strong 
positive reinforcer for James. A number of procedures had been tried in 
an effort to eliminate the behavior, but all had failed. The behavior modi- 
fication personnel at the hospital were familiar with studies such as those 
by Risley (1968) and Lovaas and Simmons (1969), which had shown that 
self-destructive behavior can be suppressed by punishing it with electric 
shock. Therefore, the behavior modification staff met with the hospital's 
medical director and other senior personnel responsible for James's care, 
and discussed the possibility of applying shock in an attempt to eliminate 
James's head banging. 

Electric shock is not a pleasant thing.” But neither was James's pres- 
ent condition. Previous episodes of head banging had left an ugly scar on 
the child's head, and life to James meant little more than days spent 
strapped in a chair that protected him from himself. At the meeting between 
the behavior modification staff and the senior hospital personnel, the 
feeling of the participants was summed up by one senior official who said, 
"Almost anything is worth a try. If we don't do something soon, one of 
these days that boy is going to kill himself." 

The following day, the behavior modification personnel secured a 
two-foot-long cylinder-shaped device that contained six flashlight batteries 
at one end and shock electrodes at the other. This device is commonly 
known as a cattle prod. Since that name has misleading and unpleasant 
associations, however, we shall refer to the device simply as the 
“shocker.” 

At first, the behavior modifiers, Pauline and Brenda, worked with 
James for about one hour daily in a small room. They stood a few feet 
from each other and instructed James to walk back and forth between 
them. One staff member held various objects, which she instructed James 
to take and carry to the other staff member. Each time he correctly fol- 
lowed the instruction, he was rewarded immediately with candy and lavish 
praise and hugs. But each time he attempted to dive to the floor, two brief 
shocks were applied to the bare skin on his leg. This proved to be quite 
punishing, in that soon he was walking back and forth without any sign of 
diving. 

Over trials, the distance between the staff was gradually increased, 
until finally they were in different rooms. When James could walk back 
and forth between the two rooms without banging his head, the program 
was moved to the ward. Since this was a place where, from past experi- 
ence. head banging was very probable, the distance between the two staff 
members was decreased to just a few feet again. Gradually, it was in- 
creased to the entire length of the ward. At this point, only one staff mem- 


ber was needed to work with James. 


*A behavior modifier contemplating the use of electric shock should consult a quali- 
f - electrical technician and follow appropriate safety guidelines, such as those given 
ie 2 


by Butterfield (1975) 
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During each one-hour daily session, Pauline instructed James to run 
various “errands” for her. These “errands” consisted mainly of getting ob- 
jects from various rooms and taking them to Pauline, and taking other ob- 
jects from Pauline to the various rooms. Sometimes James was instructed 
to go to the main desk and ask the nurse in charge for a Kleenex or some 
other item. 

At all times, Pauline was careful to keep the shocker available, but 
out of James's view. Otherwise, James would easily have learned that head 
banging would not be punished when the shocker was out of sight. 

Soon, James would never bang his head when Pauline was around. 
The staff on the ward were extremely impressed to see James roaming the 
ward, freely and safely, under Pauline's watchful eye. None of them had 
ever seen James behave that way. But although this represented a remark- 
able improvement in the boy's behavior, it was, of course, not good 
enough. The child still banged his head when Pauline was not around. In 
fact, it appeared that in her absence his head banging was a bit worse 
then it had been before the program began.’ 

To solve this problem, Pauline had to play, temporarily, an unusual 
role in the program. Hiding behind doors and around corners, she would 
watch James while other staff members dressed him, bathed him, took 
him to his meals, and generally took care of him. Whenever he began to 
bang his head, she would quickly come out from her hiding place and ap- 
ply the shock. Meanwhile the other staff members were instructed to co- 
piously reinforce James for not banging his head. 

Of course, Pauline was sometimes busy with other activities and 
could not watch James. On these occasions, Pauline was on call so that if 
James began to bang his head, a staff member would tell him, “I'm going 
to call Pauline." If he did not stop, Pauline was called to the scene, where- 
upon she applied the shocker. After a few instances of this, the threat "I'm 
going to call Pauline" was usually enough to stop the head banging. 

Still, this was a good deal less than satisfactory. Pauline could not 
always be on call. Therefore, the head nurse and other supervisory per- 
sonnel of each shift were authorized to use the shocker. The shocker was 
kept at the main desk, and all of the staff were instructed that they should 
immediately call a supervisor whenever James started to bang his head. 
To guard against possible misuse of the shocker, all staff members met 
with behavior modification personnel to discuss the use of the shocker, 
and a set of rules for applying the program were circulated and discussed. 

James's initial reaction to being shocked by someone other than 
Pauline appeared to be surprise and anger. But his head banging on 
the ward was greatly suppressed by this procedure. i 

At about this time, James started attending the special-education 
classes that were conducted at the institution. His teacher was trained in 
the use of the shocker, and in the use of positive reinforcement. James 
worked well in the classroom and soon became one of the better students. 

James's head banging decreased tremendously as a result of the 
program, and, consequently, he was allowed to move about the ward on 
his own. He quickly learned to play with other children—something he 
had never done before. At first, the ward staff were so impressed that they 
gave James a great deal of social attention for doing things without bang- 


178 

Basic 
Behavioral 
Principles 

and Procedures 


ing his head. But as the novelty of James's new repertoire wore off, it ap- 
peared that he received less and less attention. Perhaps for this reason 
there was some regression: James began banging his head again, al- 
though not nearly as frequently as before. Most of these head bangings 
occurred in the playroom—a place in which James did not particularly like 
to be. 

To offset the problem of lack of reinforcement, James was put on a 
DRO schedule. The staff were asked to give James a token for each five- 
minute period he spent in the playroom without banging his head. To pre- 
vent James from losing the tokens, the staff did not give them to him 
directly. Rather, the tokens, which could be linked together to form a 
chain, were hung on the wall in a place where James could easily see 
them. 

When James had earned seven tokens, he could leave the playroom 
and go for a walk with one of the staff members. If no staff member was 
free when James had earned his seven tokens, he was allowed to play by 
himself in the hall. Since he did not like to be in the playroom, either of 
these alternatives was reinforcing to him. 

A specially constructed data sheet was hung on the door of the play- 
room, and the attendant was instructed to record on it the number of 
times James banged his head and the number of tokens he received for 
not banging his head. The behavior modification personnel checked the 
data sheets daily and provided feedback to the attendants on their appli- 
cation of James's program. Thus, data sheets were as much a means of 
controlling staff behavior as a means of controlling James's behavior. 

The daily instances of James's head banging eventually decreased to 
a very small number. Although the shocker still had to be used occasion- 
ally, even after the program had been in effect for several months, James's 
behavior improved greatly. He could run about and play with other chil- 
dren and no longer had to be confined to his chair. 


THE PRINCIPLE OF PUNISHMENT 


Like the principle of positive reinforcement (described on pp. 18-19,) 
the principle of punishment has two parts: (1) if in a given situation 
somebody does something that is followed immediately by a certain 
consequence, then (2) that person is less likely to do the same thing 
again when he next encounters a similar situation. Such con- 
sequences are called punishers. In James’s case, shock was a punisher 
for his head-banging behavior. As with positive reinforcement, many 
repetitions of punishment of a particular response may be necessary 
before that response will noticeably decrease in frequency or proba- 
bility. As we all know, it is unpleasant to be punished, and there are 
a number of potentially harmful effects from punishment procedures, 
which we will enumerate later. For these reasons, it is very important 
that any punishment program be designed so that it is maximally ef- 
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fective with the least amount of discomfort. A number of factors in- 
fluence the effectiveness of punishment.? Let us turn to them now. 


FACTORS INFLUENCING THE 
EFFECTIVENESS OF PUNISHMENT 


1. Maximizing the conditions for a 
desirable alternative response 


To decrease some undesirable response, it is maximally effective 
to concurrently increase some alternative desirable response. This 
means that you should identify some desirable response that will 
compete with the undesirable behavior to be eliminated. You should 
also attempt to identify powerful SPs that control the desirable behav- 
ior and present these in order to increase the likelihood that the be- 
havior will occur. To maintain the desirable behavior, you should 
also have effective positive reinforcers that can be presented on an 
effective schedule. For James, the desirable alternative that was ini- 
tialy prompted and reinforced was simply walking back and forth 
between two staff members and not banging his head. 

When consulted by individuals who are thinking about using a 
punishment procedure to decrease an undesirable behavior in some- 
one else, we have always recommended that they first design effec- 
tive positive-reinforcement and stimulus control programs for desir- 
able alternative behaviors. Thus, if you are considering developing 
and using a punishment program to decrease someone's undesirable 
behavior, we strongly urge you to first review and apply the informa- 
tion in the earlier chapters concerning positive reinforcement and 


stimulus control (see Figure 12-1). 


2. Minimizing the causes of the 
response to be punished 


In order to maximize the opportunity for the desirable alterna- 
tive behavior to occur anyone attempting a punishment program 
should first minimize the causes of the punished behavior. This im- 
plies two things. First, one should try to identify the current stimulus 
control of the punished behavior. In James's case, it was clear that he 
banged his head on the floor (1) in the presence of staff members, 
and (2) if the floor had a hard surface. These stimuli were therefore 
removed in the initial training program: two behavior modification 
personnel, rather than staff members, conducted the initial training 
sessions, and an alternative setting with a carpet on the floor was 
used. Second, it is necessary to attempt to identify existing rein- 
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THANK YOU FOR 
DRIVING SAFELY, SIR. 


FIGURE 12-1. An example of the reinforcement of a desirable alternative 
behavior. 


forcers for the undesirable behavior. If the behavior is occurring, it is 
likely that occasional reinforcers are maintaining it. In James's case, it 
seems clear that occasional attention from the staff for head banging 
was the most likely reinforcer maintaining the undesirable behavior. 
This contingency was completely removed at the onset of the pro- 
gram. 

It is interesting to note that in many situations in which some- 
one is emitting undesirable behavior, careful attention to these two 
factors may yield some desirable alternative behavior that competes 
so strongly with the behavior to be decreased that punishment will 
never have to be used. However, there are situations in which pun- 


ishment procedures appear to be necessary and justified, and, there- 
fore, additional factors must be considered. 


3. Selecting a punisher 


It is very important that the punisher be effective. Some stimuli 
may seem to be punishing when in fact they are not. For example, a 
parent may say "No! Naughty boy! Stop that!" to a child who is en- 
gaging in an undesirable behavior. The child may immediately cease 
the undesirable behavior and emit some other, desired behavior, 
which will continue to receive the attention of the adult. The adult 
might then conclude that the verbal reprimand was an effective pun- 
isher. However, if the adult were to keep track of the frequency of 
that undesirable behavior in the future, she would likely find that the 
verbal reprimand was not a punisher, but in fact a reinforcer. The 
child may have stopped temporarily, because now that he has the at- 
tention of the adult it is likely that he can emit other behavior that 
will maintain her attention, at least for a short time. In other words, 
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the verbal reprimand may function as an S? for subsequent desirable 
behaviors of the child, regardless of the effects of the verbal repri- 
mand as a punisher or a reinforcer on the preceding undesirable be- 
havior. Several studies indicate that verbal reprimands often function 
as positive reinforcers, and that the long-term frequency of the unde- 
sirable behavior that evoked the reprimand is therefore likely to in- 
crease.? This is not to say that verbal reprimands or threats are never 
punishing. However, the situations in which they are effective seem 
to be those in which they are consistently backed up by a strong 
punisher. 

In order to be effective, the punishing stimulus should be fairly 
intense. Frequently, individuals start with a weak punisher in the be- 
lief that they can increase its strength if it is not effective. Many par- 
ents have experienced the following situation. A child emits some 
undesirable behavior, which is followed by a mild reprimand by the 
parent. The behavior reoccurs, and the parent provides a stronger 
reprimand, perhaps coupled with a frown. The behavior is repeated, 
and the parent severely scolds the child. The behavior is repeated, 
and the child receives a scolding and a mild slap. The behavior is re- 
peated until finally the parent delivers a severe spanking. There are 
two problems here. One is that the undesirable behavior may be very 
harmful or dangerous; if that behavior consists, for example, of 
running out in the street and playing in the traffic, then the long- 
term consequences of allowing it to occur many times are potentially 
disastrous. The second problem is that the severe punisher, the 
spanking, may have lost a good deal of its effectiveness by the time it 
is applied. Gradually increasing the intensity of a punisher is not 
nearly as effective as introducing the punisher in its final form on the 
first occasion (Azrin and Holz, 1966). 

The punisher selected should be one that can be presented im- 
mediately following the undesirable behavior. The punisher should 
also be one that can be presented in a manner such that it is in no 
way paired with positive reinforcement. This requirement often pre- 
sents difficulties in situations in which the punisher is delivered by 
an adult and the student being punished receives very little adult at- 
tention. If a student has received a lot of loving attention from an 
adult during a period of time prior to the occurrence of the undesired 
behavior, and the adult immediately presents a strong verbal repri- 
mand following the undesirable behavior, then the verbal reprimand 
might be slightly punishing. On the other hand, if that reprimand is 
the only adult attention that has been received by the student for an 
extended period of time, then that reprimand is a form of adult atten- 
tion and may in fact be reinforcing. 

Shock is a drastic form of punishment, one that should be used 
only when no other recourse is available for elminating a serious be- 


havior.‘ It seemed to be required in James's case, but less extreme 
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punishers will be quite adequate in most cases that call for punish- 
ment. As with selecting an effective reinforcer for a particular indi- 
vidual, it sometimes requires a little imagination to discover an effec- 
tive punisher. This can be illustrated by the case of Ricky, a retarded 
boy who occasionally bit or scratched other children.* The injuries he 
inflicted were so severe that in order to protect the other children, 
the staff made Ricky wear a special face mask (resembling a catcher’s 
mask) that prevented him from biting, and special heavy cloth mit- 
tens that prevented him from scratching. Both the face mask and the 
mittens were tied on so that Ricky could not remove them. 

The behavior modification personnel at the institution decided 
to tackle Ricky’s biting first and deal with his scratching later. They 
reasoned that the probable reinforcement for biting (and scratching) 
was the attention that it evoked when staff members came running to 
rescue the injured child. Extinction by withholding this reinforcer 
was out of the question, since it would likely result in many serious 
injuries. Some form of punishment seemed called for, but the behav- 
ior modification personnel did not wish to increase Ricky's dis- 
comfort unnecessarily. By observing him, they noted that he ap- 
peared to dislike having his face mask put on. Thus, the idea 
occurred to them: Why not try the face mask as a punisher? 

Thereupon, the following procedure was specified: Ricky will no 
longer be required to wear his face mask unless he bites. Immedi- 
ately after a bite, the face mask will be put on for ten minutes. He 
will be given plenty of social attention for “not biting” when the face 
mask is off. The procedure worked very well, and soon Ricky no 
longer bit other children. 

Because this procedure worked so well in the case of biting, a 
similar procedure was tried for scratching. It was decided that Ricky 
would no longer be required to wear his mittens unless he scratched. 
Immediately after a scratching episode, the mittens would be put on 
him for ten minutes. But this time the strategy failed. Rather than de- 
creasing, scratching occurred very frequently, and it appeared to be 
increasing when the behavior modification personnel called a halt to 
the procedure. It seemed that the mittens were not punishing and 
may in fact have been reinforcing. The next idea that occurred to the 
behavior modifiers was this: If the face mask worked as a punisher for 
biting, why shouldn't it also work as a punisher for scratching? But 
before following through on this idea, the behavior modifiers had to 
answer one further question: What do we do if Ricky scratches while 
he has the face mask on? It was decided that in this case, and this 
case only, shock would be applied. 

The results of this procedure were quite effective. Ricky's 
scratching gradually decreased in frequency. The number of times he 
scratched when the face mask was on decreased very quickly to zero, 


*This report is taken from an unpublished case study conducted by Brenda Geisbrecht 
and Joseph Pear at the St. Amant Centre, Winnipeg, Manitoba. 
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because of the stronger punishment for this behavior. An added fea- 
ture that contributed to the success of the procedure was that Ricky 
was reinforced on a DRO schedule, similar to that used for James, for 
engaging in behavior other than biting and scratching. 

Another type of punishment is the response-contingent with- 
drawal of positive reinforcement. A common example would be send- 
ing a misbehaving child away from the dinner table. Here, food (pre- 
sumably a positive reinforcer) has been withdrawn from the child as 
a result of her misbehavior. A disadvantage of this procedure is that 
it removes the child from the situation for a longer period of time 
than might be necessary, and thus prevents some of the learning that 
could occur in the situation. In one of our programs, a somewhat 
milder version of this method was used with a retarded girl who ate 
too rapidly. Food was a powerful reinforcer for this child. Therefore, 
whenever the child was eating too rapidly, a staff member gripped 
the child’s wrist tightly for a few seconds so that she could not get 
the food to her mouth. This delay in reinforcement was aversive 
enough that the child soon slowed to a normal rate of eating. Of 
course, the staff lavished the child with praise when this occurred. 

The most extreme form of withdrawal of positive reinforcement 
is the elimination of all possible sources of it. This is referred to as 
"time out from positive reinforcement," or more simply, time-out. 
This may be accomplished in several ways. One method is to turn 
away from the individual and ignore him for a brief period. In an- 
other method, the individual who is to receive this punisher is actually 
placed in a "time-out room," a small room that is typically com- 
pletely bare of furniture. Since there is nothing in the time-out room 
to entertain the individual, the procedure effectively eliminates al- 
most all sources of positive reinforcement. The period of detention in 
the time-out room should not be very long; about five minutes is 
usually quite effective if the principles of punishment are adhered to 
closely. However, the individual should not be let out if he is engag- 
ing in undesirable behavior (such as tantruming) when the detention 
period has elapsed. Otherwise, the undesirable behavior will be rein- 
forced. To prevent this, the staff should wait until the undesirable 
behavior has stopped for a short time— say, ten seconds.* 

There are certain problems with the use of a time-out room. Ob- 
viously, it would not be feasible to use this procedure with a severe 
head banger unless the room was well padded. Another problem, one 
that we encountered in one of our programs, was the case of a re- 
tarded girl who defecated and smeared her feces while in the time- 
out room. We guessed that the reinforcement for this behavior came 
from two sources: (1) the child enjoyed smearing her feces, and (2) 
she enjoyed the warm shower the staff give her after she engaged in 
this behavior. We found it difficult to extinguish the behavior in the 
time-out room and elsewhere. Therefore, we decided to give the child 
a shower, as before, whenever the behavior occurred. But it was to 
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be a cool shower, not a warm shower. This contingency quickly re- 
duced the undesirable behavior to zero. 


4. Delivering the punisher 


Punishment will be most effective when the punisher is pre- 
sented immediately following the undesirable behavior. If the pun- 
isher is delayed, some more desirable behavior may occur prior to 
the punisher and this desirable behavior may be affected by the pun- 
isher to a much greater extent than the prior undesirable behavior. 
The classic example of this is the mother who asks her husband, as 
he returns home from work, to spank their son, who has been bad 
earlier in the day. This request is doubly disastrous: not only does 
the child receive punishment, even though he may now be engaging 
in good behavior, but the father is punished for coming home from 
work. We do not mean to imply that delayed punishment is com- 
pletely ineffective. Most human beings are adept at bridging rather 
large times gaps between their behavior and its consequences. Even 
so, immediate punishment is much more effective than delayed pun- 
ishment. 

The punisher should be delivered after every instance of the un- 
desirable behavior (see, for example, Kircher, Pear, and Martin, 1971). 
Occasional punishment is not nearly as effective as punishment that 
follows every instance of the undesirable behavior. This implies that 
if the teacher is unable to detect most instances of the behavior to be 
punished, he should have serious doubts about the value of imple- 
menting a punishment procedure. 

The delivery of the punishment should in no way be paired 
with positive reinforcement. Such a pairing weakens the punisher. 
Worse, it may completely offset the effects of punishment and cause 
an increase in the undesirable behavior. In addition, the person ad- 
ministering the punishment should remain calm when doing so. 
Anger and frustration on his part may reinforce the undesirable be- 
havior and/or inappropriately alter the intensity of the punishment. 
A calm, matter-of-fact approach ensures that a punishment program 
will be followed as it has been designed, and that the person admin- 
istering the punishment will be less likely to apply a punisher at in- 
appropriate times (i.e., when angry or annoyed) rather than immedi- 
ately following an occasion of undesirable behavior. 


PITFALLS OF PUNISHMENT: HOW IT WORKS TO THE 
DISADVANTAGE OF THOSE WHO ARE IGNORANT OF IT 


Punishment is a tricky endeavor. Its use should be approached with 
caution, since it has a number of potential drawbacks, undesirable 
side effects, and pitfalls. 
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Strong punishment tends to elicit undesirable emotional behav- 
ior. Experiments with animals show that painful stimuli cause them 
to attack other animals—even though these other animals had noth- 
ing to do with inflicting the painful stimuli (Azrin, 1967). If this find- 
ing also applies to humans, then we should not be surprised to ob- 
serve individuals who have just been punished attacking other 
individuals.’ Clearly, such behavior is a very undesirable side effect 
of punishment. 

Strong punishment can produce other undesirable emotional 
side effects, such as crying and general fearfulness. Not only are 
these side effects unpleasant for all concerned, they frequently inter- 
fere with desirable behavior— especially if it is of a complex nature. 

Any stimulus that is associated with a punishing stimulus tends 
to become punishing itself. Such a stimulus is called a conditioned 
punisher. For example, if you are trying to teach a child to read, and 
if you punish her whenever she makes a mistake, anything associ- 
ated with this situation—such as printed words, books, the person 
who delivers the punishment, the type of room in which the punish- 
ment occurs—will tend to become punishing. The child may attempt 
to escape or avoid these stimuli. Thus, instead of helping the indi- 
vidual to learn, punishment may drive her away from people, objects, 
and events associated with the learning situation. 

Punishment does not establish any new behavior; it only sup- 
presses old behavior. In other words, punishment does not teach an 
individual what to do; at best, it only teaches what not to do. For ex- 
ample, the main defining characteristic of the retarded is that they 
lack behavior that nonretarded people have. The primary emphasis for 
these individuals, then, should be on establishing new behavior 
rather than on merely eliminating old behavior. Reinforcement is re- 
quired for the accomplishment of this task. 

Children often model or imitate adults. If adults apply punish- 
ment to children, the children are apt to do the same to others. Thus, 
in punishing children we may inadvertently be providing a model 
for them to follow in showing aggression towards others (Bandura, 
1965, 1969). Mee : 

Punishment may become addictive to the user. Because it re- 
sults in quick suppression of undesirable behavior, it can tempt the 
user to rely heavily on it and neglect the use of positive reinforce- 
ment for desirable behavior. However, the undesirable behavior may 
return after only a temporary suppression; or, some other undesirable 
behavior could occur. Like any other addict, the person hooked on 

punishment may resort to progressively heavier doses, 
thereby creating à vicious circle with disastrous side effects. l 

Before closing this section, we must emphasize that punishment 
hould be used only as a last resort. It is far too easy to devise a pun- 
R eo t procedure when a reinforcement procedure is indicated in- 
a APE of this in one of our programs was the case of a 


administering 
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retarded girl who refused to eat. The child would fight off attempts 
by the attendant to put food in her mouth. Finally, she had to be 
force-fed. Because food did not appear to be an effective reinforcer 
for this child, someone suggested that the only thing that would 
work would be to punish her refusals of food. But closer analysis re- 
vealed that this was not the case. Food might very well have been a 
powerful reinforcer for this child, but by refusing it she eventually 
received not only food but also the attention and physical contact 
that came with force feeding. Acting upon this analysis, we shaped 
and maintained the child's eating by (1) turning away for a brief 
period when she refused the food, and (2) giving her plenty of atten- 
tion and contact, first for approximations to eating and finally for ac- 
cepting the food. Clearly, this was a case in which punishment was 
not called for and in which it could have done real damage by mak- 
ing the eating situation aversive to the child. The use of positive re- 
inforcement created a very pleasant situation in which the child ate 
her food and received the attention and physical contact that she de- 
sired. 

We have discussed extensively the large number of pitfalls lying 
in wait for those who try to use punishment without being familiar 
with its principles. At least as serious are the many instances in 
which punishment is applied by people who are not aware that they 
are applying it. A common example of this is criticizing or ridiculing 
a person for inadequate behavior. Since criticism and ridicule are 
generally punishing, they will likely suppress future instances of that 
behavior and tend to drive the individual away from the person ad- 
ministering them. Yet the inadequate behavior that is criticized and 
ridiculed may be an approximation to more adequate behavior. Sup- 
pressing it could destroy the individual's opportunity to obtain the 
adequate behavior through the use of shaping. In everyday language, 
the individual becomes "discouraged" and "gives up" in his "at- 
tempt" to develop adequate behavior. In addition, because he will at- 
tempt to escape from and avoid the person administering the criti- 
cism and ridicule, that person will have lost a great deal of his 
potential reinforcing effectiveness. 

Another example of someone applying punishment without 
being aware of it is the person who says, "That was good, but. ...” 
Suppose a teenager helps a parent with the dishes and the parent re- 
plies, "Thanks for helping, but the next time don't be so slow." We 
are sure that on the basis of the previous material you can describe a 
much more effective and pleasant way for the parent to react. 

As you can see, the use of punishment can cause difficulties. In 
our view, punishment should be applied only in conjunction with 
positive reinforcement for a desirable behavior, and only for the pur- 
pose of elminating undesirable behaviors that cannot be reduced in 
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other ways. We do not recommend its use by individuals who are 
not familiar with the factors influencing its effectiveness, or with its 
potentially harmful side effects. 


GUIDELINES FOR THE EFFECTIVE APPLICATION 
OF PUNISHMENT PROCEDURES 


Punishment is clearly aversive for the one being punished, it is a lot 
of work and no fun for the punisher, and the results are frequently 
setting-specific and may or may not be permanent (depending on 
other factors). In addition, the rules for the effective use of punish- 
ment are probably violated more than those for any other principle. 
Therefore, if you propose a punishment procedure (even one in- 
volving a mild punisher), you owe it to yourself and the person 
being punished to do an effective job. Otherwise, leave it completely 
alone and use only positive reinforcement. 


1. Selecting a response. Punishment is most effective with a specific behavior 


(such as jumping on the arm of the chair) rather than a general category 
of behavior (such as wrecking furniture). 


. Maximize the conditions for a desirable (nonpunished) alternative response. 


a) Select a desirable alternative behavior that competes with the behavior to 
be punished such that the alternative behavior can be reinforced. If 
possible, select a behavior that will be maintained by the natural en- 
vironment after the termination of your reinforcement program. 

b) Provide strong prompts in order to increase the likelihood that the de- 
sirable alternative behavior will occur. 

c) Reinforce the desirable behavior with a powerful reinforcer on an appro- 
priate schedule. 


3. Minimize the causes of the response to be punished. 


a) Try to identify and eliminate many or all of the stimuli controlling 
the undesirable behavior, at least early in the training program. 

b) Try to eliminate any possible reinforcement for the undesirable be- 
havior. 


. Select an effective punisher. 


a) Choose an effective punisher that can be presented immediately fol- 
lowing the undesirable behavior. 

b) The punisher should be one that will in no way be paired with positive 
reinforcement following the undesirable behavior. 

c) Select a punisher that can be presented following every instance of the 
undesirable behavior. 


. Delivering the punisher. 


a) The punisher should be presented immediately following every instance 
of the response to be decreased. 
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b) The individual administering the punisher should do so in a calm and 
matter-of-fact manner. 

c) The person doing the punishing should also be associated with a lot of 
positive reinforcement for alternative behaviors, so that the person 
does not become a conditioned punisher. 

d) Take care not to pair punishment with reinforcement. 


6. In all programs involving punishment, careful data should be taken on the 


effects of the program. The conditions under which the program should 
be applied must be clearly stated, written down, and adhered to. 


Study Questions 
(for examination purposes) 


7. In the subsection “Selecting a punisher,’ 


1. How were reinforcement, shaping, schedules of reinforcement, and to- 


kens used in the program for eliminating James's self-destructive behav- 
ior? 


2. How do we identify stimuli as punishers or reinforcers? 
3. How did Pauline attempt to maximize the conditions for a desirable al- 


ternative response with James during the early part of the program for 
eliminating his self destructive behavior, 


4. In the program for eliminating James's self destructive behavior, how did 


Pauline try to minimize the probability that the response to be punished 
would occur during the initial training program? 


5. What are the problems with gradually increasing the intensity of the 


punishing stimulus over successive applications of that stimulus? 


6. How would you determine if a verbal reprimand was a punisher for a 


particular child? 


we described a sequence (in- 
volving a potential reprimand) of events and behaviors that might be 
characterized as a behavioral chain. What was that sequence? 


8. What is a common example of the response-contingent withdrawal of 


positive reinforcement that is applied as punishment by parents to their 
children? 


9. In the subsection "Delivering the Punisher," we suggested that if the 


teacher is unable to detect most instances of a behavior to be punished, 

then he should have serious doubts about the value of implementing a 

punishment procedure. 

a) From the information in this chapter, what reasons can you cite to 
support this suggestion? 

b) What alternative means of managing the situation are availabe to the 
teacher? 


189 10. What are four concerns of the teacher in regard to delivering the pun- 
Punishment isher? 
11. Briefly cite seven pitfalls of the application of punishment. 


Study Exercises 
(to be practiced by the reader) 


1. Consider the behavior of speeding (driving a car in excess of the speed 
limit) in our culture. 
a) Briefly outline the current contingencies with respect to speeding. 
b) Compare the current contingencies for speeding with the guidelines 
for the effective application of punishment procedures. Identify those 
guidelines that either were simply not attended to or were flagrantly vio- 
lated by the lawmakers and law enforcers. 

2. Consider the behavior of littering the highways in your area. Repeat the 
analysis that you applied in study exercise 1. 


Self-Modification Exercise 
(to be practiced by the reader) 


Choose a behavior of yours that you would like to decrease. With the help of 
a friend, describe in detail a punishment program that would likely decrease 
your behavior. (Make the program as realistic as possible, but do not apply 
it.) Your punishment program should be consistent with all of the guidelines 
for the effective application of punishment. 
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geons were reinforced for responding in the presence of a green light 
on a VI schedule, and also for responding in the presence of a red light 
on a VI schedule, the schedule and lights alternating within the experi- 
mental chamber. When a condition was added such that responses in 
the presence of the green light also produced an electric shock, the 
performance in the presence of the green light decreased and there 
was a corresponding increase in the rate of responding to the red light. 


Azrin and Holz (1966) summarized the results of their research on 
punishment that had been conducted during approximately the preced- 
ing five years. They outlined a number of influences on the effec- 
tiveness of punishment, and a review of the literature since that time 
suggests that none of their major conclusions have been refuted. Much 
of the material in this chapter is based on their work. 


The potential reinforcing value of reprimands was demonstrated 
nicely in a study by Madsen, Becker, Thomas, Koser, and Plager (1970). 
A teacher was instructed to increase her use of the reprimand ‘Sit 
down!" when the children were actually out of their seats. As a con- 
sequence of the teacher saying “Sit down!" more often, the children's 
out-of-seat behavior increased. 


Even in cases where electric-shock punishment may appear war- 
ranted, one should always search the literature for alternatives. A very 
dramatic example of an alternative treatment concerns what may have 
been the life-saving treatment of a six-month-old baby (Sajwaj, Libet, 
and Agras, 1974). Sandra was admitted to the University Hospital in 
Charleston, South Carolina because of a failure to gain weight that was 
associated with the constant bringing up of food without nausea (rumi- 
nating). She was underweight and undernourished, and death was a 
distinct possibility. Preliminary observations indicated that a few 
minutes after being given milk, Sandra would begin ruminating and 
would continue for about twenty to forty minutes until she had appar- 
ently lost all the milk she had previously consumed. Now considering 
the seriousness of the problem (Sajwaj, et al. cited statistics indicating 
that one in six or seven babies with rumination die), a program of elec- 
tric-shock might appear to have been warranted. Indeed, Sajwaj et al. 
cited several studies demonstrating the effectiveness of shock punish- 
ment in eliminating rumination. However, for several reasons outlined by 
Sajwaj et al., the authors were reluctant to utilize shock. Instead, they 
utilized lemon juice as a punisher. During treatment, Sandra's mouth 
was filled with lemon juice immediately after staff members detected 
the vigorous tongue movements that reliably preceded her rumination. 
After sixteen feedings with lemon juice, the rumination had decreased 
to a very low level. To ensure that the improvement was due to the 
treatment program, Sajwaj et al. suspended the use of lemon juice for 
two feedings. The result was a dramatic increase in rumination. The 
lemon-juice therapy was reintroduced and again led to a dramatic de- 
crease in rumination. Following additional treatment Sandra was dis- 
charged to foster parents, who maintained the treatment until it was no 
longer necessary. Five months later, Sandra was returned to her natural 
parents, a much improved little girl. 


Bostow and Bailey (1969) successfully applied time-outs of two 
minutes duration (plus an additional fifteen seconds of quiet behavior 
at the end of that time) for disruptive and aggressive behaviors of two 
(Continued) 
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retarded patients in a state-hospital ward setting. In another study, 
White, Nielsen, and Johnson (1972) compared the effectiveness of time- 
out durations of one minute, fifteen minutes, and thirty minutes in con- 
trolling deviant behaviors in a group of twenty institutionalized retarded 
individuals. They found that one-minute time-outs were not as effective 
in general as fifteen- and thirty-minute time-outs, but there was little 
difference between the two longer time-out intervals. Thus, excessively. 
long time-outs do not necessarily increase the effectiveness of the time- 
out as a punisher. For additional discussion of a variety of time-out 
studies, see MacDonough and Forehand (1973). 


A detailed set of guidelines for the application of time-out in an insti- 
tutional setting has been prepared by the Research Unit staff at The 
Manitoba School, and is available upon request from Dr. Glen Lowther, 
Medical Superintendent, The Manitoba School, Portage la Prairie, Mani- 
toba, Canada. 


Some authors cite aggression as a side effect of a punishment pro- 
gram; others cite punishment programs that have had desirable sup- 
pressing effects without producing aggression. Examples of the former 
are Foxx and Azrin (1972) and Pendergrass (1972), who both reported 
temporary aggressive behaviors of both adults and children exposed to 
punishment procedures. On the other hand, Johnston (1972), in an ex- 
cellent review of punishment, reported that many studies in applied set- 
tings not only did not observe undesirable side effects, but did observe 
increases in desirable behaviors as a consequence of a punishment 
program. 


: This was demonstrated very clearly in an experiment by Lovaas, 
Schaeffer, and Simmons (1965) with autistic children. In the first part of 
the experiment, the children were reinforced with candy for pressing a 
lever, and they demonstrated very high lever-pressing rates. On several 
occasions, immediately following a lever press the experimenter said 
“No!” which had practically no effect on the rate of lever pressing. The 
severely disturbed children were then given a training session in which 
their extreme self-stimulation and tantruming behaviors were followed 
by a "No!" and a brief electric-shock punisher. After several pairings of 
the word "No!" with the shock in these sessions, the children were 
again given an opportunity to press a lever for candy reinforcement. 
When their lever pressing was occurring at a high rate, the experi- 
menter said “No!” and the presentation of this verbal stimulus now had 
a very strong suppressing effect on the lever pressing. 


Study Questions on Notes 


1. What is "behavioral contrast"? 
2. How are the two examples of behavioral contrast reported by Rey- 


nolds different? 
3. How did Madsen et al. demonstrate that reprimands can actually be 


reinforcing? 
4, Describe in three or four sentences the "lemon-juice therapy" re- 


ported by Sajwaj et al. 
(Continued) 
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Establishing 
A Desirable Behavior 


y Using ESCAPE 
and AVOIDANCE Conditioning 


“Scotty, would you like to play with your new toy?” 


A NEW TOY FOR SCOTTY 


Scotty was a seven-year-old institutionalized severely retarded boy, diag- 
nosed as having Down's syndrome, who habitually beat his head with his 
hands.* This self-destructiveness was so severe that Scotty spent twenty- 
four hours a day in a crib with his hands tied to his waist and a modified 
football helmet on his head. Because of the severity of the problem, the 
staff psychologist designed a behavioral procedure involving electric- 
shock punishment (similar to procedures described in Chapter 12). This 
quickly eliminated Scotty's head beating in the training situation. But what 
about other situations? 


*This case study was described in Whaley and Mallot (1971). For the original report, see 
Whaley and Tough (1970). 
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The psychologist realized that it would not be safe to let the boy run 
freely on the ward until some desirable alternative behavior to head beat- 
ing was developed. To accomplish this, staff members placed Scotty in a 
highchair and put a large metal truck on the tray in front of him. An elec- 
tric timer wired to the truck measured how long the boy touched the 
truck. Since Scotty engaged in this activity hardly at all, it was clear that 
special procedures would be required to get him to do so. Before describ- 
ing these procedures, we should emphasize that prior to being imple- 
mented they were reviewed and approved by the Ethical Review Com- 
mittee of the institution. This committee also monitored the program 
throughout the time that it was in effect. (As we shall point out in Chapter 
29, all behavior modification programs should be subject to appropriate 
ethical controls. This is especially critical when aversive events such as 
shock are to be used.) 

At the beginning of the program, Scotty was given trials in which a 
mild electric shock was presented through electrodes attached to his leg; 
simultaneously, a buzzer sounded. When Scotty touched the truck, the 
buzzer and the shock turned off automatically. At first, it was necessary to 
prompt Scotty by guiding his hand to the truck when the buzzer and 
shock came on. After about a dozen trials, however, he did this himself 
immediately upon the presentation of the two stimuli. After each trial, 
Scotty's hand was taken from the truck, if necessary, before a new trial 
was begun. 

This procedure is called escape conditioning because Scotty es- 
caped the shock (that is, he removed or terminated it) by placing his hand 
on the truck. When he escaped consistently, the escape procedure was 
changed to what is called avoidance conditioning. To keep the buzzer off 
and prevent shock from occurring, Scotty had to keep his hand on the 
truck. The instant he removed it the buzzer sounded, and three seconds 
later shock occurred. By keeping his hand on the truck continuously, 
Scotty could avoid shock altogether. 

Although at the beginning of the program Scotty practically never 
touched the truck, during the subsequent avoidance procedure he kept his 
hand on it almost continuously for up to several hours— depending on 
how long the session lasted. During that time, he did not beat his head. 
The next step was to teach Scotty to touch another toy. The truck was re- 
placed with a toy tiger stuffed with metal shavings so that it could be 
used, as was the truck, to electrically record the amount of time Scotty 
held his hand on it. As with the truck, Scotty kept his hand on the toy con- 
stantly and did not beat his head. 

Gradually, Scotty began to grasp and manipulate the toy tiger. At 
times, he was observed to even hug and kiss it. The shocker was then dis- 
connected, although the buzzer remained operative. Since Scotty never re- 
leased the toy long enough to learn that the shock would no longer occur, 
it appeared that the shock contingency was no longer necessary. Next, the 
buzzer was disconnected. Nevertheless, the boy continued to hold the ti- 
ger about as much as before. 

Other stuffed animals were then faded in. Occasionally, it was neces- 
sary to present a short booster session with shock, but this quickly rees- 
tablished the desired behavior and thus was required very infrequently. 
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The psychologist therefore decided that the time had come to let Scotty 
roam the ward freely with a stuffed toy. The boy clutched the toy wherever 
he went and did not beat himself. 

Perhaps some readers will think it cruel to make a child so depen- 
dent on a toy through the use of electric shock. Actually, the child was 
much better off with this tendency than without it. No longer did he have 
to be restrained in his bed twenty-four hours a day. He could run, play, 
and learn social interaction and other vital skills. At first, he was extremely 
dependent on his toy; in fact, once when he was accidentally deprived of 
it he beat his head ferociously. But over the space of about a year, he 
gradually became less and less dependent on it. Eventually, he did not 
beat his head even when he did not have his toy with him. 


ESCAPE AND AVOIDANCE 


Two principles were used in Scotty’s case: escape conditioning and 
avoidance conditioning. The principle of escape conditioning states 
that there are certain stimuli whose removal immediately after the oc- 
currence of a response will increase the likelihood of the response. In 
the escape procedure used with Scotty, the removal of shock follow- 
ing the response of touching the truck increased the probability that 
Scotty would touch the truck each time shock was presented. 

Note that escape conditioning is similar to punishment in that 
both procedures involve the use of some sort of aversive event, such 
as shock. However, escape conditioning is just the opposite of pun- 
ishment. In the punishment procedure, the likelihood of future be- 
havior is decreased as a result of presenting a punisher following past 
instances of the behavior. In the escape-conditioning procedure, 
the likelihood of a behavior is increased as a result of terminating or re- 
moving a punisher following past instances of the behavior.’ 

Escape conditioning has the disadvantage that the aversive 
stimulus must be present in order for the desired response to occur. 
For example, when Scotty was on the escape procedure shock had to 
be presented before he would touch the toy. Therefore, escape condi- 
tioning is generally used not as a terminal contingency but rather as 
preparatory training for the introduction of avoidance conditioning. 
Thus, Scotty was given avoidance conditioning after he had acquired 
escape behavior. 

In avoidance conditioning, a response prevents the occurrence 
sher. This increases the probability of occurrence of the re- 
sponse if it is low, and maintains that probability at a high level. 
Thus, the principle of avoidance conditioning states that a behavior 
will increase in frequency if it prevents a punisher from occurring. 
voidance procedure with Scotty, touching a toy pre- 


of a puni 


During the a 
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vented shock from occurring. When Scotty took his hand off the 
truck, the buzzer sounded and shock occurred three seconds later. 

The sound of the buzzer when Scotty removed his hand from 
the toy was a warning stimulus: it signaled the occurrence of shock 
three seconds later. Other names for warning stimulus are conditioned 
aversive stimulus and conditioned punisher. Eventually, Scotty would 
keep his hand on the toy just to avoid the sound of the buzzer, and 
it was thus possible to dispense with the shock altogether. This type 
of avoidance conditioning, which includes a warning signal that en- 
ables the individual to discriminate a forthcoming punisher, is called 
discriminated avoidance conditioning.” Finally, the buzzer itself was dis- 
connected and the behavior was maintained without either buzzer or 
shock — except, as we mentioned, for an occasional booster session as 
new toys were faded in. 

How was it possible to eventually maintain the behavior of toy 
touching without shock or the buzzer? There are two probable an- 
swers. First, it is in the nature of an avoidance procedure that when 
the behavior occurs regularly, the punisher does not occur. Therefore, 
when the procedure no longer applies, regardless of what the indi- 
vidual does, it takes quite some time for him or her to discover that 
performing the behavior is not what keeps the punisher from occur- 
ring. Second, after Scotty began holding the toy, he probably came in 
contact with positive reinforcers that tended to maintain the behavior 
apart from the termination of the shock. After all, normal kids enjoy 
hugging stuffed animals, and it seems reasonable to suspect that this 
activity became reinforcing for Scotty too. Also, other people may 
have frequently praised Scotty for the nice way he was playing with 
his toys. Thus, two things—the tendency for an avoidance response 
to be very resistent to extinction and the availability of positive rein- 
forcement for desirable behavior— probably account for the fact that 
Scotty continued to hold stuffed animals long after this behavior no 
longer prevented shock from occurring. 

You may also wonder why Scotty eventually ceased beating his 
head, even when he did not have his toy with him. The answer 
would seem to be related to why he beat his head in the first place. 
This behavior was probably reinforced by the attention Scotty re- 
ceived for it. Moreover, because he had to be severely restrained, he 
had no opportunity to learn to obtain attention in other ways. How- 
ever when he could move about freely without beating his head, 
more desirable behaviors could occur and be reinforced with atten- 
tion. Eventually, these more desirable behaviors took precedence over 
the gruesome one of head beating. 

Although escape conditioning seems to be less frequent than 
avoidance conditioning in our society, there are examples of escape 
conditioning with which we are all familiar (see Table 13-1). 


TABLE 13-1. Examples of escape conditioning. 


AVERSIVE SITUATION 
1. A child sees an 
adult with a bag 
of candies. The 
child begins to 
scream, "candy, 
candy, candy." 


2. Child A slaps 
(and continues to 
slap) child B. 
Child B cries 
loudly. 


3. A retarded child 
has had shoes 
put on her that 
are too tight and 
are pinching her 
toes. 


4. An adult frowns 
at a child and 
says, "Pick up 
that paper you 
threw on the 
floor." 


5. A staff member in 
an institution 
comes upon a 
pile of smelly 
feces on the 
floor. 


ESCAPE 
RESPONSES BY 
INDIVIDUAL 

To terminate the 
screaming, the adult 
gives the screaming 
child a candy. 


An adult removes 
child A from the 
vicinity of child B. 


The child makes 
loud noises in the 
presence of an adult 
and points to her 
toes. 


The child picks up 
the paper. 


The staff member 
walks away without 
cleaning it up. 


REMOVAL OF 
AVERSIVE SITUATION 


The child stops 
screaming. 


The slapping ceases. 


The adult removes 

the shoes (and per- 
haps puts on larger 
shoes). 


The adult stops 
frowning. 


The staff member 
does not have to 
clean up the feces, 
and escapes the 
aversive smell. 


LONG-TERM EFFECTS 


In the future, the 
adult is more likely 
“to give into” the 
screaming child 
(and the child is 
more likely to 
scream when she 
sees a candy bag, 
because of the posi- 
tive reinforcement 
she gains for doing 
SO). 


Child B is likely to 
cry more quickly in 
future situations in 
which she is 
slapped. 


The child is more 
likely to make loud 
noises and point to 
her sore feet (or to 
other areas of pain) 
more quickly in sim- 
ilar situations in the 
future. 


The response of 
picking up the paper 
(or obeying the 
adult) is likely to 
occur more quickly 
in future situations 
in which the adult 
frowns while giving 
instructions. 


In the future, the 
staff member will 
likely walk away 
from feces on the 
floor. 


Avoidance conditioning influences us every day. Unfortunately, it is 
common in the classroom, where children may be required to give 
the right answer in order to avoid the teacher's ridicule or anger and 
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to avoid a poor mark. Our legal system is based entirely on avoidance 
conditioning. We pay our taxes to avoid going to jail. We put money in 
parking meters to avoid getting a ticket. We pay our parking fines 
in order to avoid a court summons. 

Like punishment, escape and avoidance conditioning involve 
aversive stimulation. They therefore suffer from much the same dis- 
advantages as punishment (see Chapter 12). Aversive stimuli can 
produce undesirable emotional behaviors, such as aggression and 
general fearfulness, which, among other things, interfere with the 
learning process. Moreover, any stimulus associated with punishment 
tends to become aversive itself. Thus, an individual will tend to avoid 
or escape any situation or person associated with the use of punishers. 
Clearly, this does not further an individual’s social, emotional, and 
intellectual development. 

It is encouraging to note that Scotty did not show any of these 
side effects of aversive stimulation. He evidenced no hesitation in 
going to experimental sessions. In fact, he showed a great deal of 
affection toward the person who worked with him, such as by ap- 
proaching him with outstretched arms when spotting him among a 
group of people. Nevertheless, escape and avoidance, like punish- 
ment, should generally be thought of as last-resort procedures: they 
should not be used if positive reinforcement will do the job. 


PITFALLS OF ESCAPE AND AVOIDANCE: 
HOW THEY WORK TO THE DISADVANTAGE OF 
THOSE WHO ARE IGNORANT OF THEM 


Often, people inadvertently use escape and avoidance conditioning to 
establish behaviors they probably would rather not see established. 

Children often learn to escape and avoid punishment in ways 
that are not particularly desirable. An everyday example is the child 
who desperately promises "T'll be good; I won't do it again" in order 
to escape or avoid a spanking for some infraction of parental author- 
ity. When such pleas are successful, the pleading behavior is 
strengthened and thus increased in frequency under similar circum- 
stances, but the undesirable behavior the parent meant to decrease 
has probably been affected very little or not at all. Verbal behavior 
having little relation to reality may be increased while the undesir- 
able target response may persist in strength. 

Prisoners frequently learn to make the “right” verbal statements 
in order to obtain early parole, but all too often it is merely their ver- 
bal behavior that has been modified, not their antisocial tendencies. 
Apologies, confessions, and the "guilty look" characteristic of trans- 
gressors in all walks of life can be traced to similar contingencies. Ly- 
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ing or misrepresenting the facts is another way to avoid punishment, 
if one can get away with it. 

Behaviors more harmful than inappropriate verbal behavior can 
also result from unintentional escape or avoidance contingencies. For 
example, we have observed some retarded children who bite them- 
selves after doing something they have been told not to do. What 
causes this? It is quite possible that this behavior has been strength- 
ened because adults are less likely to punish a child who appears to 
be punishing himself. 

Another pitfall of escape and avoidance is the inadvertent estab- 
lishment of conditioned aversive stimuli, to which an individual then 
responds in such a way as to escape or avoid them.” By their exces- 
sive use of punishment, some teachers transform themselves, their 
classroom, and the learning materials they use into conditioned aver- 
sive stimuli. All too frequently, this situation produces individuals 
who avoid teachers, school, and books, and who therefore fail to ad- 
vance academically. Clearly, this is a most unfortunate consequence 
of escape and avoidance conditioning. 

Another pitfall of escape conditioning is that in many situations 
it maintains undesirable behaviors by the teacher. This can easily 
be seen in the first example in Table 13-1. 


GUIDELINES FOR THE EFFECTIVE APPLICATION OF 
ESCAPE AND AVOIDANCE 


The following rules should be observed by any person who 
applies escape and avoidance. 


Given a choice between maintaining behavior on an escape or an avoid- 
ance procedure, the latter is to be preferred. There are two reasons for 
this. First, in escape conditioning the punisher must be present prior to 
the target response, whereas in avoidance conditioning the punisher oc- 
curs only when the target response fails to occur. Second, in escape condi- 
tioning the target response does not occur when the punisher is not pres- 
ent, whereas in avoidance conditioning responding decreases very slowly 
when the punisher may no longer be forthcoming. 
2. The target behavior should be established by escape conditioning before 
' iis put on an avoidance procedure. Avoidance behavior is usually easier 
ipd ien if escape behavior is established first, as was done in the case 
is See conditioning, a conditioned punishing stimulus should 
3. Dae impending punisher. This enhances conditioning by providing 
y o Ming hat failure to respond will result in aversive stimulation. An 
* be m the natural environment is the printed word “VIOLATION” 
example Y meter, which indicates to the motorist that he may receive a 
E P. i et if he does not put a coin in the meter. The buzzer served a 
ger ctor for Scotty, indicating that shock would occur three sec- 
simi 
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onds after he removed his hand from the toy. (Presumably, although the 
authors of the study don’t say whether this was so, if Scotty placed his 
hand back on the toy within three seconds, the buzzer would shut off and 
shock would be prevented. Similarly, putting a coin in a parking meter 
removes the “VIOLATION” sign and prevents a ticket.) 

Escape and avoidance conditioning, like punishment, should be used cau- 
tiously. Because these procedures involve aversive stimuli, they can result 
in harmful side effects, such as aggression, fearfulness, and a tendency to 
avoid or escape any person or thing associated with the procedure. 


Positive reinforcement for the target response should be used in con- 
junction with escape and avoidance conditioning. Not only will it help 
strengthen the desired behavior, it will also tend to counteract the unde- 
sirable side effects mentioned above. 

As with all the procedures described in Part II of this text, the individual 
concerned should be told —to the best of his or her understanding — about 
the contingencies in effect. However—again, as with all these proce- 
dures— instructions are not necessary for escape and avoidance condi- 
tioning to work. 


Study Questions 
(for examination purposes) 


10. 


. How are conditioned positive reinforcers and 


. Explain in behavioral terms, with an example of your own, 


. How is escape conditioning similar to the punishment procedure? How 


is it different? 


. In what two ways is escape conditioning different from positive rein- 


forcement? In what way are they similar? 


. What are two differences between escape conditioning and avoidance 


conditioning? 


conditioned punishers 
similar, and how are they different? 


. Give two other names for "conditioned punisher.” 


What two factors probably account for the observation that Scotty even- 


tually continued to touch the toy even without the application of a shock 
or the buzzer? 


) why individ- 
uals frequently reinforce the undesirable behavior of other individuals. 


(Hint: See the first example in Table 13-1.) 

Explain how escape conditioning might maintain an adult’s behavior of 
responding inappropriately to a child’s extreme social withdrawal. 

Why should escape- and avoidance-conditioning procedures be consid- 
ered only as a last resort? 


Briefly describe at least three pitfalls of escape and avoidance. 


(If pos- 
sible, use examples other than those in the text.) 
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11. Why is an avoidance procedure generally preferred to an escape proce- 
dure? 


Study Exercises 
(to be practiced by the reader) 


1. Construct a chart similar to Table 13-1 in which you present five examples 
of avoidance conditioning that have influenced your behavior. Present 
each example in terms of the categories of situation, warning signal, re- 
sponse, consequences, and long-term effects. 

2. Successful avoidance behavior means that an individual has been condi- 
tioned to respond (probably to a warning signal) in such a way as to 
avoid the occurrence of a punisher. This means that the avoidance behav- 
ior might persist even if (for whatever reasons) the environment has 
changed such that the punisher will no longer be presented, regardless of 
the individual's behavior. Why is this so? Give two examples from your 
own experience. 


Self-Modification Exercise 


(to be practiced by the reader) 


Identify a fear or anxiety reaction that you experienced recently. Describe 


your reaction and its stimulus control in some detail. Is your reaction best 
analyzed as positively reinforced, avoidance, or escape behavior? Justify your 
analysis with reference to behavioral principles and procedures. 


EXTENDED DISCUSSION AND NOTES 


uni: 
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(Continued) 

Thus, negative reinforcement is equivalent to what this text refers 
to as escape conditioning (that is, increasing the probability of a re- 
sponse by making the removal of a particular type of stimulus—which is 
called a punisher, an aversive stimulus, or a negative reinforcer— con- 
tingent on that response). However, there is disagreement among be- 
haviorists on the logical validity of distinguishing between positive and 
negative reinforcement. Most notably, Michael (1975) has argued 
against the distinction on the basis that it is logically meaningless to 
distinguish between cases in which a stimulus is removed and cases in 
which a stimulus is presented. The removal of one stimulus (for ex- 
ample, extreme cold or heat) always logically implies the presentation 
of another stimulus (in this case, a more moderate temperature), and 
vice versa. Thus, instead of distinguishing between presenting and re- 
moving stimuli, Michael would speak only of events involving changes 
in the stimuli present in a situation. Such stimulus-change events are 
reinforcing when they increase the probability of responses they follow, 
and they are punishing when they decrease the probability of responses 
they follow. Thus, Michael would get rid of the distinction between pos- 
itive and negative reinforcement, but would retain the distinction be- 
tween reinforcement and punishment. 

The manner in which we defined punishment in Chapter 12 is 
consistent with Michael's defintion of that term (as well as with that of 
other writers, such as Azrin and Holz, 1966). However, Skinner's defini- 
tion of punishment is different. He does not define it in terms of its ef- 
fect in reducing behavior. Rather, he defines punishment as the presen- 
tation of a negative reinforcer or the removal of a positive reinforcer 
following a response. According to this definition, in order to say that 
presenting or removing a particular stimulus constitutes punishment, it 
is necessary to first show that that stimulus is a negative or positive re- 
inforcer, respectively. 


Two less common types of avoidance conditioning are not described 
in this chapter. One type does not involve a warning signal. This type of 
avoidance is known most commonly as Sidman avoidance (after Murray. 
Sidman, who studied this type of avoidance extensively with lower or- 
ganisms); it is also known as timed avoidance. An interesting experiment 
was conducted with Sidman avoidance by Hefferline, Kennan, and Har- 
ford (1956). In this experiment, individual normal adults sat in a chair 
and listened to music. Attached to their thumbs were tiny wire elec- 
trodes that measured extremely small thumb twitches. The individuals 
were instructed to listen to the music through earphones, and were told 
the music might occasionally be interrupted by noise. (Other individuals 
were given somewhat different instructions, but for our purposes their 
results will not be described.) During the first few minutes, the music 
continued uninterrupted and Hefferline et al. recorded the number of 
thumb twitches. Then, during an experimental period, thumb twitches 
affected music and noise according to an escape/Sidman-avoidance 
procedure. When the noise was superimposed on the music, a thumb 
twitch would enable the individual to escape from the noise for fifteen 
seconds. Subsequent thumb twitches during that time (without any 
warning signal) would continue to postpone the noise for fifteen-sec- 
ond intervals. Under these conditions, the rate of the thumb twitching 
increased greatly—to the extent that the individuals were able to listen 
to the music without interruption. (An interesting sidelight to this ex- 
periment was that the individuals were completely unaware—that is, 
(Continued) 
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(Continued) 
they were unable to verbalize the fact—that they had been conditioned 
to thumb-twitch in the fashion described above.) 

A third type of avoidance, one that may or may not involve a 
warning stimulus, has been referred to as passive avoidance. With this 
type of program, individuals avoid punishing consequences by not mak- 
ing a response (that is, by remaining passive). For example, beekeepers 
instruct others that they can avoid being stung by a bee if they remain 
perfectly still when in the vicinity of a buzzing bee. 


Many phobias (extreme and unreasonable fears) can be attributed to 
some sort of unfortunate escape and/or avoidance conditioning that has 
occurred in the patient's history. For example, Lubetkin (1975) reported a 
case of brontophobia and astraphobia (abnormal fear of thunder and 
lightning) that was "traced to the patient's early childhood years in Eu- 
rope during W.W. Il in which she was exposed to highly traumatizing 
daily bombings and firings." The phobia was so intense that during 
thunderstorms she "would go to the basement of her home and suffer 
in terror until the storm subsided.” A very interesting treatment was 
used in this case. The patient was given training on how to relax, and 
was taken to a local planetarium that had been contracted to provide 
highly realistic presentations of lightning and thunderstorms. The pa- 
tient relaxed, and then signaled the projectionist to start the show. 
There were approximately eight three-minute presentations of the storm 
per visit. The phobia was markedly alleviated after only eight visits by 
the patient to the planetarium. (The procedure used in this case is related 
to treatments that are described in more detail in Chapters 14 and 26.) 


Study Questions on Notes 


1. What is the difference between the definition of a punisher in this 
text and Skinner's definition of a negative reinforcer? 

2. Why did Michael recommend that we dispose of the term "negative 
reinforcer’? Discuss. 

3. What is Sidman avoidance conditioning? 

4. Briefly describe two situations in which you were influenced by Sid- 
man avoidance conditioning. 

5. How is the Hefferline et al. experiment related to the Greenspoon ex- 
periment described in Chapter 2, note 5? 

6. What is passive avoidance? 

7. Describe a situation in which you responded on a passive-avoidance 
schedule with a warning stimulus. 

8. Describe a situation in which you responded on a passive-avoidance 
schedule with no warning stimulus. 

9. What are brontophobia and astraphobia? (No, they're not dinosaurs!) 


Procedures Based On 
RESPONDENT CONDITIONING 


The principles and procedures described in the previous pages of 
this book are mainly those of operant conditioning. The basic tenet 
of operant conditioning is that a behavior is increased or decreased 
by its consequences. As we have seen, consequences that cause a be- 
havior to increase are called reinforcers, and those that cause it to de- 
crease are called punishers. However, some behavior modification 
procedures do not seem to fit the model of operant conditioning. 
Rather, these procedures seem to be described more accurately in ref- 
erence to another type of conditioning. This type of conditioning has 
several names: it is variously referred to as Pavlovian conditioning, 
classical conditioning, or respondent conditioning.* 


"The content of this chapter has forced us to write it in a style that is somewhat more 
technical than that of the previous chapters. This may cause hardship for some who 
are primarily interested in practical rather than general and theoretical information. 
However, those who are so inclined can omit this chapter without seriously distorting 
the continuity of the text. 
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Respondent conditioning (as we shall call it here) is based on the fact 
that certain stimuli automatically elicit certain responses apart from 
any prior learning or conditioning experience. These “automatic” 
stimulus-response relationships are called unconditioned reflexes. Ex- 
amples of such reflexes are shown in Figure 14-1. 

The reflexes in Figure 14-1 are unconditioned in the sense that 
the stimuli elicit the responses without prior conditioning (in other 
words, they are inborn). For each of the responses in Figure 14-1, 
there are stimuli that do not elicit them. For example, assume that a 
particular stimulus (such as the sight of food) does not presently eli- 
cit a particular response (such as salivation) in a particular individual 
(such as a baby who has not yet eaten that particular type of food). 
The principle of respondent conditioning states that if that stimulus 
(the sight of food) is followed closely in time by a stimulus (food in 
the mouth) that does elicit the response (salivation), the former stim- 
ulus (the sight of food) will also tend to elicit the response (saliva- 
tion) in the future.! 


STIMULUS RESPONSE ELICITED 
Food in the mouth —— — ———— — ————— —- Salivation 
Lemon juice in the mouth —— — —— —— ——- Salivation and puckering of the lips 
Cinder in the eye — = — Tears 


————+ Sneezing 

+ Emotional responses (such as an increased 
rate of heartbeat and the secretion of 
adrenalin into the blood) 


Pepper in the nose ————— — 
Painful jab — - — 


FIGURE 14-1. Some unconditioned reflexes. 


The diagrams in Figure 14-2 illustrate the main difference be- 
tween respondent- and operant-conditioning procedures. The upper 
box in Figure 14-2 shows that respondent conditioning occurs when 
one stimulus is followed closely in time by another stimulus that elicits 
a particular response. The result of this temporal pairing of these 
two stimuli is that the first stimulus comes to elicit the same re- 
sponse that the second stimulus elicits. The lower box shows that op- 
erant conditioning occurs when a response is followed closely in time 
by a particular type of stimulus. The result depends on whether the 
stimulus is reinforcing or punishing: if it is reinforcing, the response 
will tend to occur again; if it is punishing, the response will tend not 
to occur again. To follow the parenthetical examples in Figure 14-2, 
the reader should consider the case of an infant or young child who 
has had little experience with different types of food. 


RESPONDENT CONDITIONING 
PROCEDURE OF RESPONDENT CONDITIONING: 


S (sight of food) -—~___ 
Pairing $ R (salivation) 
S (food in mouth) 
RESULT OF RESPONDENT CONDITIONING: 


S (sight of food) tends to elicit R (salivation) 


OPERANT CONDITIONING 


Reinforcement 
PROCEDURE OF REINFORCEMENT: 


R (putting candy in mouth) ————————— S (taste of candy) 


{ reinforcement 


RESULT OF REINFORCEMENT: 


R (putting candy in mouth) tends to occur again 


Punishment 
PROCEDURE OF PUNISHMENT: 
R (putting hot pepper in mouth) ————————— S (taste of hot pepper) 
| punishment 


RESULT OF PUNISHMENT: 


R (putting hot pepper in mouth) tends not to occur again 


FIGURE 14-2. Respondent and operant conditioning compared. 


At this point you may be asking, "Until this chapter, you were talk- 
ing about behaviors that were controlled mainly by their consequences; 
now you seem to be talking about behaviors that are controlled only 
by antecedent stimuli, without any mention of consequences. Does 
this mean there are two different kinds of behaviors?" The answer to 
this seems to be yes. As we mentioned in earlier chapters, behaviors 
that are controlled by consequences have sometmes been referred to 
as "voluntary" behaviors. More technically, they are called operant 
behaviors, because they operate on the environment to generate con- 
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sequences (and are in turn controlled by those consequences). How- 
ever, some of our behaviors seem to be reflexive (that is, elicited by 
prior stimuli quite apart from the consequences of the behaviors). 
These are called respondent behaviors. Examples of such behavior are 
presented in Figure 14-1. It seems that many components of our 
emotional reactions (that is, certain aspects of fear, anger, love, hate, 
and so forth) are of this sort. 

Any behavioral sequence is likely to include both respondent 
and operate conditioning. In some situations, we might select certain 
stimuli and responses from a sequence in order to study respondent 
conditioning. Or, we might examine that same sequence somewhat 
differently and study operant conditioning. Consider the behavior se- 
quence shown in Figure 14-3. As you can see the sound of the bell 
in Figure 14-3 appears to be involved in both respondent and op- 


erant conditioning. 


Behavioral Sequence 


Ice-cream wagon 
approaches with 

bell ringing = 
continuously 


Boy runs —> Boy bites —- Boy salivates 


to street ice-cream while ice- 
and buys cream is in 
ice-cream mouth. 


(a) Respondent conditioning 


S, (sound of bell) ———... 
NEL d 


Pairing 
S, (ice-cream in mouthj——— T 


R (salivation) 


Result: S, (bell) tends to elicit R (salivation). 


(b) Operant conditioning 


S? (sound of bell) —> R (boy runs to street — Reinforcer 
and buys ice-cream) (ice-cream in mouth) 


Result 1: R tends to occur again on the next presentation of SP, 
Result 2: The sound of the bell tends to be a conditioned 


reinforcer (because of appropriate pairing with 
ice-cream). 


FIGURE 14-3. A behavioral sequence that includes both operant and re- 
spondent conditioning. 
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Another example of a behavioral sequence that involves both re- 
spondent and operant conditioning might be as follows: Suppose that 
a small child runs to pet a large dog. Never having had any rea- 
son to fear dogs, the child shows no fear now. Suppose, however, 
that the dog playfully jumps at the child and knocks him down. 
Quite naturally, the child will begin crying because of the pain and 
surprise of this rough treatment. Now what will happen the next 
time the child sees that dog or one that resembles it? Of course, the 
child will probably start crying and showing other types of fear be- 
havior. Thus, a stimulus (sight of dog) that previously did not elicit a 
particular response (crying and other types of fear behavior) comes to 
do so because it was paired with a stimulus (suddenly being knocked 
down) that did elicit that response. 

It is important to note that in this example, the child’s experi- 
ence with the dog will have two important effects on his behavior. 
First, as we mentioned, the child will have a fear reaction (consisting 
of trembling, crying, the secretion of adrenalin into the blood, and an 
increased rate of heartbeat, among other things) whenever he sees a 
dog that resembles the one that knocked him down. This fear reac- 
tion to dogs is, as we mentioned, a response that has been respond- 
ently conditioned. Second, any behavior (such as looking over a 
back-yard fence) that leads to the sight of a dog resembling the one 
that knocked him down will likely decrease in frequency. Moreover, 
the child will tend to avoid or get away from such dogs. In other 
words, those dogs will have become conditioned punishers for the 
child. In Chapter 12, we stated that a stimulus that is not punishing 
can become punishing if it is paired with a stimulus that is punish- 
ing. Some psychologists would theorize that the sight of the dog has 
become a conditioned punisher because it elicits fear as a result of 
respondent conditioning, and that the fear so elicited is aversive.? 

It is evident that the same procedure that will cause a stimulus 
to elicit fear will also cause that stimulus to be a conditioned pun- 
isher. This is illustrated in Figure 14-4. 

It is not always possible to discuss a behavioral sequence just in 
terms of operant conditioning. For example, it might be said that the 
child in the preceding example had been punished for approaching 
dogs by having been knocked down by a dog. Although this might 
explain why the child no longer approaches dogs, it does not explain 
why he experiences fear (which can be measured in terms of internal 
bodily reactions, such as increased level of adrenalin in the blood 
and an increased rate of heartbeat) when he sees a dog. It therefore 
appears that it is necessary to add the principle of respondent condi- 
tioning to our list of basic behavioral principles. 
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Behavioral Sequence 


Sight of dog close by = 
Boy approaches ———- Boyis ———- Boy cries (and 
dog knocked shows emotional 

down distress called 
"anxiety" or 
"fear''). 


(a) Respondent Conditioning 


S, (sight of dog — _ 


close by) PSS 
Pairing R (“anxiety”) 
S, (being knocked — 7 
down) 


Result : S, (sight of dog close by) tends to elicit R (“anxiety”). 


H 
(b) Operant Conditioning 
S (sight of dog ——— R (boy approaches ————» Punisher 
close by) dog) (boy is 
knocked down) 
Result 1: R tends not to occur again. 
Result 2: The sight of a dog close by tends to be a conditioned 
punisher (because of pairing with being knocked down), 
(The sight of a dog may have become a punisher at 
least in part because it will now elicit anxiety as 
diagrammed above.) 
E 


FIGURE 14-4. The development of a stimulus as a conditioned punisher. 
Some psychologists would theorize that in this example, the sight of the 
dog has become a conditioned punisher because it elicits anxiety as a result 
of respondent conditioning. 


The behavior modification procedures described in subsequent 
pages of this chapter seem to be based in large measure on respond- 
ent conditioning. This is not to say that they do not also involve op- 
erant conditioning, or that respondent conditioning was not oper- 
ating in some of the procedures described previously in this book. 
Both types of conditioning are present and probably interact in vir- 
tually all behavior modification procedures. Although this com- 
plicates the description of behavior modification procedures, it prob- 
ably does not hinder the practice of behavior modification. Indeed, as 
we have seen repeatedly throughout this book, increasing the num- 


ber of principles that are applied to a behavior problem generally in- 
creases the likelihood that the treatment will be successful. 


APPLICATIONS OF RESPONDENT CONDITIONING 
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Certain kinds of positive reinforcers can be very troublesome. 
People who find pastries and other sweets overly reinforcing tend to 
eat too many fattening foods and become overweight. Similarly, 
people who find cigarettes, alcohol, and other harmful commodities 
overly reinforcing tend to overindulge in these reinforcers to the det- 
riment of their health and well-being. People who obtain sexual rein- 
forcement in socially unacceptable ways—for instance, by seducing 
children—tend to endanger others, by exposing them to potentially 
harmful experiences, and themselves, by risking imprisonment and 
other social sanctions. 

Aversion therapy has been developed largely as an attempt to 
counteract the power of undesirable reinforcers (those that tend to be 
overindulged in or that harm others). Before describing some of the 
methods of aversion therapy, we should caution the reader that their 
safe and effective use requires special expertise. These procedures, as 
the label aversion therapy implies, involve the use of aversive stimu- 
lation. As we have seen in Chapter 12, there are serious dangers in 
the use of aversive stimulation. It should therefore be used only by 
qualified experts who know when and how it is most likely to be ef- 
fective, and how to guard against potentially harmful side effects. 

Basically, aversion therapy involves the repeated pairing (that is, 
over a number of trials) of an undesirable reinforcer with an aversive 
event. The rationale is that the undesirable reinforcer should then be- 
come less reinforcing, because it will come to elicit a response similar 
to that elicited by the aversive stimulus. 

For example, in the treatment of alcoholism a person may be 
given a drug that will make him nauseous. Just before the drug takes 
effect, he is given a sip of an alcoholic beverage. Thus, the sight, 
smell, and taste of the drink is followed immediately by nausea. (See, 
for example, Lemere and Voegtlin, 1950.) This Pairing of alcohol with 
nausea is repeated over a number of sessions. Eventually, alcohol it- 
self should tend to elicit nausea, which would tend to cause the indi- 
vidual to avoid alcohol. How well the therapy works in any given 
case probably depends, at least in part, on other treatment factors 
and on operant processes operating in the natural environment— such 
as whether the client receives social reinforcement for his subsequent 
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choosing of nonalcoholic over alcoholic beverages at parties, restau- 
rants and bars.* This proposition is in accord with the statement at 
the beginning of this chapter that respondent- and operant-condi- 
tioning principles are probably never manifested independently of 
each other; they interact, and behavior modifiers should utilize their 
potential interaction whenever possible. Having made this point, we 
now continue with our emphasis on the respondent-conditioning as- 
pects of aversion therapy. 

Electric shock is frequently used as an aversive stimulus in aver- 
sion therapy. The main reasons for its use are that (1) it is relatively 
easy to administer, (2) it can be delivered instantly, (3) its intensity 
and duration can be precisely controlled, (4) it can be used on re- 
peated trials in a single session, and (5) it is aversive to virtually ev- 
eryone. 

In one commonly used procedure (cf. Feldman and MacCulloch, 
1965), a client is shown slides of the undesirable reinforcer. As she 
looks at each slide, such as a picture of very fattening food (assuming 
that she is being treated for obesity) a painful shock is delivered 
through electrodes attached to her arm or leg. The slide is removed at 
the same time that the shock terminates, so that relief from shock is 
associated with the absence of the undesirable reinforcer. In fact, 
many behavior therapists maintain that a slide showing a desirable 
alternative reinforcer (such as nutritious, nonfattening food in this 
example) should be presented at the same time that the shock ceases. 
Thus, the undesirable reinforcer is paired with shock, and the desir- 
able alternative reinforcer is paired with relief from shock. This mod- 
ified form of aversion therapy is called aversion-relief conditioning. 

Symbolic representations (such as pictures, slides, and film- 
strips) of the undesirable reinforcers, rather than the actual rein- 
forcers themselves, are commonly used in aversion therapy. This is 
largely a matter of convenience. Hundreds of slides or filmstrips deal- 
ing with a wide variety of troublesome reinforcers can easily be 
stored in the therapist’s office. Moreover, it is relatively easy to make 
new slides or filmstrips appropriate to individual cases. These stimuli 
can then be presented at specified intervals and for specified dura- 
tions, and can be associated with the onset or termination of the 
aversive stimulus in a precisely controlled manner. Moreover, their 
use precludes various problems that would arise if the actual unde- 
sirable reinforcers were used during therapy. To give an extreme ex- 
ample, one obviously would not use real children to decondition a 
child molester. It is generally acceptable, however, to use pictures of 
children in various poses. 

In many cases, aversion therapy is conducted not only in the 
absence of the actual undesirable reinforcers, but even in the absence 


*For a review of the behavioral treatment of alcoholism, see Nathan (1976) 
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of external representations of those reinforcers. Instead, internal repre- 
sentations are used. Most people can visualize internal pictures called 
images. Moreover, these internal images need not be merely visual; 
they can also be auditory (i.e., one can imagine various sounds), tac- 
tile (i.e, one can imagine touching or being touched), kinesthetic 
(i.e., one can imagine making various movements), and so forth. In 
short, all the sensations evoked by the physical world can be repre- 
sented in one's imagination. 

The use of images or imaginary stimuli is illustrated in a case 
reported by Lesser (1967). The client was a young man who wished 
to eliminate his drug habit, which involved injections of morphine 
several times per week. Before the initiation of aversion therapy, sev- 
eral nonaversive conditioning procedures were tried. For example, by 
means of assertive training (described later in this chapter), the 
client's social skills were improved so that he would have some de- 
sirable alternative forms of reinforcement. These procedures were 
only partially successful, and it was therefore decided to use aversion 
therapy to associate anxiety with the paraphernalia and process of 
drug administration. Prior to treatment, the client was instructed to 
vividly imagine going through a sequence of five steps while, for two 
of the steps, he picked up and held the equipment that he used 
when actually giving himself an injection. During each step of the se- 
quence, the client was given a shock as soon as he signaled to the 
therapist that he had a clear image of that step. The shock continued 
until the client had (1) ceased to visualize that step, which he in- 
dicated to the therapist by saying "stop," and (2) dropped any of the 
equipment he had been holding during that step. The client was 
given the sequence three times per session, and received two ses- 
Sions per week. For the first sixteen sessions, shock was given during 
every step. Thereafter, it was given intermittently. A ten-month fol- 
low-up indicated that the client continued to successfully avoid 
"hard" drugs following treatment. 

You might wonder whether this case actually illustrates only the 
process of punishment, and not that of respondent conditioning. In- 
deed, the procedure that was used does seem very similar to that of 
punishment. There are, however, some basic differences. First, the 
client was instructed by the therapist to engage in the behavior that 
was followed by shock. Thus, if punishment was the critical process 
that was operating, it would seem that attending therapy sessions 
and following the therapist's instructions would have ceased before 
the actual drug-taking behavior was eliminated. Second, shock did 
not occur contingent on the actual drug-taking behavior. Rather, it 
was paired with stimuli (such as the injection equipment and the 
imagined situation and actions accompanying injections) that were 
involved in the drug-taking behavior. Finally, after aversion therapy 
had been in effect for eight sessions, the client took drugs on one oc- 
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casion. The procedure had therefore not, at least at that time, suf- 
ficiently punished the behavior so as to eliminate it completely. Nev- 
ertheless, the client reported that he did not get the “good feeling” 
he had experienced on previous occasions when he took drugs. It 
therefore appears that the main effect of aversion therapy in this case 
was to reduce the reinforcing effect of the drug rather than to directly 
punish the drug-taking behavior. 


Covert Sensitization 


The preceding case was presented primarily to illustrate the use 
of imagery in aversive conditioning. The stimuli that were imagined 
related to experiencing the undesirable reinforcer (the effects of the 
drug). These stimuli were paired with electric shock, which is, of 
course, a very real aversive stimuli. A commonly used procedure called 
covert sensitization (Cautela, 1966), however, involves having the 
client imagine both the undesirable reinforcer and the aversive stim- 
ulus. This procedure is so named because the pairing of the stimuli 
occurs only in the client's imagination (in other words, it is "covert") 
and the anticipated result of this covert pairing process is that the 
undesirable reinforcer becomes aversive (that is, the client becomes 
"sensitized" to it). One use of the procedure is with clients who wish 
to give up smoking (as described by Irey, 1972). For example, during 
a particular trial the client might be instructed to vividly imagine 
lighting a cigarette after dinner in a restaurant, inhaling, and then 
suddenly becoming so violently ill that he vomits all over his hands, 
his clothes, the table cloth, and the other people at the table. He con- 
tinues to vomit and then, when the contents of his stomach are empty, 
to gag while the other people in the restaurant stare at him in amaze- 
ment and disgust. In short, the scene is made extremely realistic and 
aversive. When the maximum degree of aversiveness is felt, the client 
is instructed to imagine turning away from his cigarette and immedi- 
ately beginning to feel better (as in aversion-relief conditioning). The 
scene concludes with the client washing up in the bathroom, without 
his cigarettes, and feeling tremendous relief. 

From this brief survey of aversion-therapy procedures it can be 
seen that a number of possibilities are available. All involve the basic 
process of reducing the reinforcing value of a stimulus by pairing it 
with an aversive stimulus. The procedures differ mainly in two ways: 
(1) the stimulus that is paired with the aversive stimulus may be the 
actual stimulus whose reinforcing power the client wishes to reduce 
or eliminate, or it may be a pictorial or imaginary representation of 
that stimulus; (2) the aversive stimulus may be an overt physical 
event such as electric shock, or it may be imaginary. Probably the 
relative effectiveness of the procedures vary to a large extent with 
particular types of clients and problems. 
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Convenience and greater control over stimulus presentations are 
factors that often favor the use of pictures or images over the use of 
the actual undesirable reinforcer. Images have the added advantage 
of providing a wider variety of stimuli and situations (it would 
clearly be impractical to have a client actually vomit in a real restau- 
rant, for example). It might be argued that images of an undesirable 
reinforcer are so far removed from the natural environment that their 
use is not likely to produce generalization to that environment. On 
the other hand, if the client has a “good imagination," then making 
those images aversive might generalize to the natural environment 
just as readily as would making the actual undesirable reinforcer 
aversive (since many of the covert stimuli in both cases may be 
identical). 

Regardless of the type of stimuli that are used, there are several 
general guidelines that qualified therapists typically follow in apply- 
ing aversion therapy: 


1. During conditioning trials, the onset of the stimulus to be made aversive 
(that is, the undesirable reinforcer) is generally followed 0.5 to 1.0 seconds 
later by the aversive stimulus. The pairing continues for a few seconds, 
and then the two stimuli terminate at approximately the same time. 

2. The client is encouraged to experience the undesirable reinforcer (or its 
symbolic representations) as fully as possible while also experiencing the 
aversive stimulus. The aversive stimulus must be strong enough to trans- 
mit its effects to the undesirable reinforcer, rather than the other way 
around. 

3. The termination of the aversive stimulus is usually paired with a stimulus 
that the client wishes to have as a positive reinforcer that will replace the 
undesirable reinforcer. 

4. Reinforcement is normally arranged in the natural environment so as to 
follow instances when the client chooses the desirable alternative rein- 
forcer over the undesirable reinforcer. 

5. Occasional “booster” aversion-therapy sessions may be required to main- 
tain the low reinforcing value of the undesirable reinforcer after the con- 
clusion of therapy. Follow-ups should be conducted periodically to deter- 
mine whether booster sessions are necessary and to evaluate the 
effectiveness of the treatment. 


Systematic Desensitization 


As explained above, aversion therapy works primarily by caus- 
ing an undesirable reinforcer to become aversive, or at least less rein- 
forcing. Often, however, the opposite type of problem is encoun- 
tered: a stimulus that the client wishes to be reinforcing, or at least 
neutral, elicits a strong aversive reaction. The little boy who was 
knocked down by a dog in the example at the beginning of this 
chapter may continue long afterwards to have a strong fear of dogs. It 
would, of course, be unfortunate if this fear prevented him from en- 
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joying dogs who posed no real threat to him. Many people have fears 
that are so intense that they are virtually incapacitated by them. For 
example, a person might have such an intense fear of heights that he 
cannot walk up a single flight of stairs or look out of a second-story 
window without experiencing acute anxiety. Or, to take another ex- 
ample, a person might be so terrified of crowds that she cannot bear 
to go into public places. Surprising as it may seem, trying to con- 
vince these people that their fears are irrational often has no benefi- 
cial effect. Indeed, they usually know that their fears have no rational 
basis, and would like to control them but cannot do so because the 
fears are automatically elicited by specific stimuli, Such intense, irra- 
tional, incapacitating fears, which are called phobias, generally require 
treatment by professional psychologists or psychiatrists. 

One method that has proved quite effective for treating phobias, 
and that appears to be based in large part on respondent-condi- 
tioning procedures, was developed by Wolpe (1958) (for the history 
of this method, see Chapter 28). Wolpe originally hypothesized that if 
a response incompatible with fear could be made to occur in the 
presence of a stimulus that normally produced fear, then the in- 
compatible response would inhibit the occurrence of fear on sub- 
sequent presentations of that stimulus. In other words, Opposite re- 
sponses to a given stimulus tend to reciprocally inhibit each other. 
Wolpe referred to this process as reciprocal inhibition. Wolpe hypothe- 
sized that a reasonable treatment for phobias was to identify re- 
sponses that were opposite to fear and to teach the client to engage 
in those responses in situations that normally produced fear. The 
three classes of responses that he used to inhibit fear were relaxation, 
assertion responses, and sexual responses. The fear-antagonistic be- 
havior that Wolpe found most suitable to his purpose was relaxation, 
and the term used to describe his therapy that incorporates relaxation 
is systematic desensitization. 

A procedure for training people to completely relax their mus- 
cles had previously been developed by Jacobson (1938), and Wolpe 
(1958, 1969) adapted this procedure for use with his clients who ex- 
perienced debilitating fears. In generai, the relaxation procedures re- 
quire a client to alternately tense and then relax a set of muscles so 
that they are more deeply relaxed following the tensing than before. 
The client is taught to apply this tension-relaxation exercise to mus- 
cles of all major areas of the body (such as arms, neck, face, and 
shoulders). By following the appropriate procedures during several 
training sessions, many individuals can eventually learn to relax 
deeply in a matter of minutes. (A more detailed description of this 
procedure is given in Chapter 26.) 

Systematic desensitization first involves teaching the client to 
readily induce deep-muscle relaxation. In addition, by interviewing 
the client thoroughly, the therapist obtains a detailed description of 
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all of the stimuli and situations that are related to the debilitating 
fear or anxiety that the client experiences. Thus, the therapist identi- 
fies not only those stimuli that elicit the most intense anxiety, but 
also related stimuli that elicit lesser degrees of anxiety. The client 
then rates these stimuli on a 100-point scale in which a rating of 0 in- 
dicates that the stimulus elicits the least amount of anxiety and a rat- 
ing of 100 indicates that it elicits the greatest amount of anxiety. The 
anxiety-eliciting stimuli or situations are then arranged in a hier- 
archy, with those that elicit the least anxiety at the bottom and those 
that elicit the most anxiety at the top. The following hierarchy might 
be constructed for a client who is terrified of riding in crowded ele- 
vators: 


Being pressed against the wall in an elevator that is filled to capacity. 
Being in an elevator that is three-fourths full. 

Being the only passenger in an elevator. 

Being in an elevator that has four people in it. 

Being in an elevator that has two people in it. 

Standing outside an elevator door while waiting for the elevator to arrive. 
Walking toward an elevator twenty feet away. 


- Walking toward an elevator from the front door of the building in which 
it is located. 


1. Walking to an appointment on the top floor of a tall building th 
elevator. 


NOP UAN ww 


at has an 


Note that although the client in this h 
most afraid of being in an elevator that is fille 
more frightened of being the only Passenger 
being in an elevator with several other people. 
is important to construct a hierarchy that is v. 
client. A hierarchy that is valid for one client 
another, even though both may have the s 


phobia. (For an example of a more complex hi 
case, see Table 26-1.) 


After the therapist has taught the client how to induce self-re- 
laxation and has constructed a hierarch 


ypothetical example is 
d to capacity, he is also 
in an elevator than of 
This illustrates that it 
alid for the particular 
may not be valid for 
ame general type of 
erarchy from an actual 
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X 
onds of relaxation, the client is again requested to imagine the scene. 
After two successes of imagining a scene (with a fifteen- to thirty- 
second period of relaxation after each presentation), the therapist 
then instructs the client to clearly imagine the next scene in the hier- 
archy. At the first indication of anxiety, the therapist immediately in- 
structs the client to cease imagining the scene. Then, after the client 
is again completely relaxed, the therapist instructs him to imagine the 
previous scene. If no anxiety is experienced with that scene, the next 
scene in the hierarchy is attempted again. In this manner of alter- 
nately imagining scenes and then relaxing without imagining them, 
the client gradually proceeds through the least anxiety-eliciting to the 
most anxiety-eliciting scenes. At each step, relaxation counteracts the 
anxiety elicited by that scene.? When the client finishes the last scene 
in the hierarchy, he can generally encounter the actual feared situ- 
ations without undue distress.* No doubt, the positive reinforcement 
he then receives helps to maintain his continued interactions with 
the stimuli that previously elicited intense, debilitating fear. 

Here are some of the guidelines that many therapists follow 
when using systematic desensitization. 


1. Before beginning desensitization, they ensure that: 

a) the client has been properly trained to induce self-relaxation; 

b) all anxiety-eliciting stimuli have been indentified, and ranked in a 
valid hierarchy; 

c) the client can form clear images. If he cannot (which is very rare), 
special training in forming images may be required before therapy 
can begin. 

2. During desensitization sessions: 

a) they are very careful to present the scenes in such a manner that 
they elicit the absolute minimum amount of anxiety. If the client is 
taken too rapidly through the hierarchy, or if he is not sufficiently 
relaxed, the desired result might not be obtained. Indeed, there is 
the danger that the opposite effect might occur: the client might be 
made even more fearful of the anxiety-eliciting stimuli than he already 
is. 

b) they are careful not to present reinforcement (for instance, by saying 
"good") when the client imagines a scene without reporting anxiety. 
Such reinforcement might tend to prevent the client from reporting 
anxiety when he experiences it. 

3. After the client has successfully progressed through the hierarchy, the 
therapist should (if possible) arrange for positive reinforcement to oc- 
cur on at least the first few occasions that the client interacts with the 
stimuli to which desensitization was directed. 

4. Follow-ups should be conducted to ensure that the treatment remains 
effective over a long period of time. If a relapse occurs, booster ses- 
sions should be given. 
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FIGURE 14-5. An example of a failure to identif 


i ) y all anxiety-eliciting stimuli 
prior to desensitization (guideline 1b, p. 217). 


Assertive Training 


Another technique that many writers consider to be within the 
respondent-conditioning orientation is that of assertive training. In 
an important text on assertive training, Lange and Jakubowski (1976, 
p. 38) define assertion as follows: “Assertion involves sta 


nding up for 
personal rights and expressing thoughts, 


feelings, and beliefs in di- 
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rect, honest; and appropriate ways which respect i 
es eo Se earlier in this eet as bass 
s responses as one class of responses that TE 
used to reciprocally inhibit fear and anxiety.” Wolpe 2 i 
sertive training to be especially appropriate in an Sree yas 
ations in which anxiety occurred. Examples might be Aes ick 
which a person shows meek, submissive behaviors sid yq 
sertive reaction is called for (such as speaking up inste a letn 
others trample all over you), or awkward behavior in p» i "We 
call for a certain amount of social grace (such as aski pes 
date ing someone for 

Although Wolpe assumed that I i i 
Peres eh the anxiety in Bo n ieri 
the behavior changes that occur in a client during T S 
might be due largely to operant-conditioning procedures kimm and 
Masters (1974, p. 93) have suggested that “by far the sheet co ers 
d assertive training technique is behavior rehearsal. This aene d 


use 

requires that the client and therapist act 

r i à out relevant in 

interactions. Part of the time, the client plays himself Mine ten: 
ra- 


g the role of a significant person in the client's life h 
mployer, or spouse." It would seem that this "role s 
1 functions. It helps the therapist determine : hat 
behaviors need to be changed in the client so that he can ^u * 
vorable reactions from the people in his environment. It ain s 
vides the therapist with the information necessary to re- BA 
vant $s for the client so that behavior appropriate to eed pum 
modeled and reinforced in their presence as he plays the vale of hi = 
im- 


self. Also, it is possible that by playing the roles of significant peopl 
ment, a client learns how to better predict hue rae 


havior (even as it is said that an actor, as he bec 
d in the role of the character he is secca uen 
” that character), and hence to adjust m 
behavior accordingly. Thus, although assertive training appears t p 
in the historical tradition of respondent-conditioning aec i 
seems reasonable to interpret the behavior of the client and the ri 
apist during assertive training largely in terms of se his 
tioning principles.® Examples of assertive training from thi a 
point are given on pP- 232-3, 244—5 and 251-2. Cu. 
The following general guidelines for assertion therapists ar 
paraphrased slightly from Lange and Jakubowski (1976, p. 5): 20 
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1. Teach the differences b 
re should be taken to avoid confusing assertion 


politeness. (Extreme ca 
with aggression.) 

2. Help people to identi 
rights of others. 

3. Reduce existing emotional 
ing assertively. 


fy and accept their own personal rights as well as thi 
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and cognitive (see Chapter 27) obstacles to 
5 act- 
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4. Use active practice to develop assertive skills: arrange for the client to 
be reinforced for acting assertively in appropriate situations both during 
role-playing and in the natural environment. 


Other Respondent-Conditioning Applications 


Most respondent-conditioning procedures presently in use in- 
volve the establishment or elimination of aversive reactions to spe- 
cific stimuli. It would be a mistake, however, to think that this ex- 
hausts the possibilities. Therefore, this chapter concludes with two 
examples of other uses of respondent conditioning. 

One example is a treatment for chronic constipation that was 
developed by Quarti and Renaud (1964). Defecation, the desired re- 
sponse in cases of constipation, can be elicited by administering a 
laxative. However, reliance on such drugs to achieve regularity is not 
the healthiest solution because of the undesirable side effects that of- 
ten result. Quarti and Renaud therefore had t 
themselves with a distinctive electrical stimulus 
electric current—immediately prior to defecating 
tially elicited by a laxative, and then the am 
gradually decreased until defecation was elicited by the electrical 
stimulus alone. Then, by applying the electrical stimulus at the same 
time each day, several of the clients were also able to get rid of the 
electrical stimulus, because the natural-environment stimuli charac- 
teristically present at that time each day acquired control over the be- 


havior of defecating. Thus, these clients achieved regularity without 
the continued use of artificial stimulation. 


The second example of a res 
that does not involve conditionin 


heir clients present 
—a mild, nonpainful 
. Defecation was ini- 
ount of the drug was 


pondent-conditioning procedure 
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1. Identify a stimulus (S,) that reliably elicits the response that you desire to 
condition. 

2. Identify a stimulus (S.) that does not presently elicit the response, but that 
would be convenient or desirable to have elicit the response. 

3. Repeatedly pair the two stimuli by presenting S. first and quickly (within 
0.5 to 1.0 seconds) following it with S,, 

4. Gradually decrease the number of trials during which S, is presented, but 
continue to present S. so that it alone will eventually elicit the response. 


5. If possible, positively reinforce the desired response. 


A CAUTIONARY NOTE 


Chapters 2-12 of this book described basic principles and procedures 
of operant conditioning, along with guidelines for their application. 
Chapter 13 presented information on escape and avoidance condi- 
tioning, and Chapter 14 has presented information on aversion ther- 
apy (including covert sensitization), systematic desensitization, and 
assertive training. Chapters 15-26 describe additional information for 
designing and executing behavioral programs. We believe that mas- 
tery of the material in Chapters 2-12 and 15-26 will enable the reader 
to effectively design, implement, and maintain a variety of behavior 
modification programs. We do not make such a claim for the material 
in Chapters 13 and 14. Additional information and guidance is neces- 
sary before the reader attempts to carry out programs involving es- 
cape or avoidance conditioning, aversion therapy (including covert 
sensitization), systematic desensitization, and assertive training. 
Chapter 26 provides information for carrying out a self-desensi- 


tization program. 


Study Questions 


(for examination purposes) 


1. What is the basic tenet of operant conditioning? 

2. Give five examples of unconditioned reflexes (two of which are not in 
the text). Describe both the stimulus and the response. 

3. State the principle of respondent conditioning. Clearly describe and dia- 
gram three examples of respondent conditioning (one of which is not in the 


text). 
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4. By using diagrams and examples, distinguish between respondent and 
operant conditioning. mee 
5. Explain how respondent conditioning and operant conditioning can in- 
teract to cause an individual to escape or avoid a particular stimulus. Use 
diagrams and examples to clarify your explanation. 

6. For what general type of problem is aversion therapy used? Give three 
examples (one of which is not in the text). 

7. Why should aversion therapy be used onl 
practitioners? 

8. Describe the basic procedure and rationale 
example of aversion therapy. 


y by competent professional 


of aversion therapy. Give an 


9. State three reasons that electric shock is frequently used as an aversive 
stimulus in aversion therapy. 


10. State why slides showin 
aversion therapy. 

11. Describe the basic procedure and rationale of 

tioning. Give an example of aversion-relief conditionin 
12. Describe the basic procedure and rationale of cov 
an example of covert sensitization. 


13. For what general type of Problem is system. 
Give an example. 


14. Explain why relaxation is used in s 


15. Explain how a hierarchy of 
atic desensitization. 


16. In one page or less, summarize the basic procedure of Systematic desen- 
sitization. 


g undesirable reinforcers are frequently used in 


aversion-relief condi- 
g- 
ert sensitization. Give 


atic desensitization used? 


ystematic desensitization. 
aversive situations is constructed in system- 


17. Who developed systematic desensitization? 


18. Briefly describe a res 


pondent-conditioning procedure for treating consti- 
pation. 
19. Describe a respondent-conditionin 


8 procedure for treating enuresis. 
20. Define assertive training. 
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(Continued) 

quired the ability to elicit the conditioned response (CR) because that 
CS had been paired with an unconditioned stimulus (US) that elicited 
an unconditioned response (UR) that was similar to the CR. 

Skinner (1935) was the first to clearly distinguish between this 
type of conditioning, which he called respondent conditioning, and the 
type he called operant conditioning. 

The terms classical and instrumental conditioning, i 
coined by Hilgard and Marquis (1940) in an early SHEER CH 
learning, are frequently used synonyms for respondent and operant 
conditioning, respectively. 


This theoretical description of how an interaction between respond- 
ent and operant processes can result in escape behavior, avoidance be- 
havior, and punishment was first formulated systematically by Mowrer 
(1960). The theory is called two-factor theory because it is based on two 
principles of conditioning. It should be noted that this theory is not ac- 
cepted by some learning theorists (such as Hernstein, 1969). 


In addition to respondent conditioning, Pavlov discovered respond- 
ent extinction: If the CS is presented repeatedly without being followed 
by the US, eventually the CS will no longer elicit the CR. It has been ar- 
gued by some behavior therapists that relaxation and anxiety hier- 
archies are unnecessary components of the desensitization procedure. 
Addressing this issue as a learning theorist, Rachlin (1976, p. 195) 
noted that in systematic desensitization, "a new CR [relaxation] is 
learned which can transfer to CS's other than the one originally used. 
Simple [respondent] extinction tends to be too narrowly focused, too 
weak to overcome strong conditioning, and too easily overcome by re- 
conditioning with the original US or even with other CS's [that still elicit 
the anxiety reaction]. 

The great majority of data supporting the effectiveness of systematic 
desensitization comes from surveys of reported case histories. This data 
is often difficult to interpret because the case histories frequently in- 
volve procedures other than systematic desensitization, utilize subjective 
verbal reports from clients as the major source of information and do 
not have adequate baseline or follow-up data. Nevertheless, the infor- 
mation on case histories is impressive. Wolpe (1958) originally claimed 
90-percent of 210 clients to be either cured or much improved after an 
average of thirty-one treatment sessions. Sessions were typically one 
week or several days apart. For more thorough reviews of these and other 
data, see Paul (1969a, 1969b) and Kazdin and Wilcoxon (1976). The latter 
authors pointed out that although systematic desensitization appears to 
be very effective, it is not clear that its effectiveness is due to the reasons 
Wolpe and others theorized. 


It appears that Salter (1949) was the first person to describe asser- 
tive-training procedures in detail. However, assertive training did not ap- 
pear to gather acceptance as a behavior-therapy technique until Wolpe 
(1958, 1969) emphasized it. Rimm and Masters (1974) have outlined sev- 
eral plausible reasons why the writings of Wolpe on assertive training 
have had greater impact than those of Salter (pp. 82, 83). 


This position also appears to have been expressed by Rimm and 
Masters (1974, p. 94) who stated, "The assertive procedures described 
in this chapter incorporate several well-established principles borrowed 
from the operant literature (for example, the use of successive approxi- 
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Some Preliminary 
Considerations 
to Effective 


Programming Strategies 


INSTRUCTION, MODELING, 
GUIDANCE an 
SITUATIONAL INDUCEMENT 


Consider the following general categories of behavior problems: 


A desired behavior occurs too infrequently (behavioral deficit) 
An undesired behavior occurs too frequently (behavioral Ee 
A desired behavior never occurs (behavioral deficit) s 


A desired behavior occurs, but in the presence of inappropriate stimuli 
: i a ull 
the presence of appropriate stimuli (behavioral in- 


ASNH 


and not in 
appropriateness). 


Thus far, what basic procedures for dealing with such problems h: 
this book given you? For category 1 you will probably answer iS ias 
forcement.” For category 2 you will probably say, “extinction rein- 
forcement of alternative behavior, DRL, DRO, and pimp 2 
category 3 you will probably reply, "backward chaining and pe or 
ing.” And for category 4 you will probably respond, “stimulu id 
crimination training and fading." ase Css 
A perfect score— very good! (Of course, we gave you some mod 
eling just in case you needed it— but more about that later.) B ^ E 
rushing ahead with a program based on the above techni " £ ore 
reflect on whether there might not be some faster or R ors 
o 
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228 achieve your objective. Specifically, what we have in mind is looking 


Some for stimuli that already control the desired behavior and, if possible, 
Preliminary, devising a strategy that incorporates them. Such use of existing forms 
i n A $ " 
Cr cnin of stimulus control can be conveniently discussed under the headings 


Programming of instruction, modeling, physical guidance, and situational induce- 
Strategies Baer 


INSTRUCTION 


Instruction is the presentation of verbal stimulation 
or printed words, in order to control behavior. 
behavior-control technique dates back to the 
started communicating with each other. 
this way" or, more simply, "Dinosaur!" 
primitive instruction to run for safet 
frequently uses instruction without full 
erful behavior modification procedure 
control has been demonstrated quite hu 
the popular television program 
one stunt the signs "MEN" and 


, Such as spoken 
Obviously, its use as a 
time that people first 
"There's a dinosaur headed 
might be one example of a 
y. Today, almost everyone 
y appreciating what a pow- 
it is.! Powerful instructional 


ny parents: “I don't know 
-=> (insert "to pick up his 
to do his homework’; “to come home 


house”; “not to play his 


the phone so long"; * 
i ; “not to slam the 
but he never listens." : modifier p is no 


how many times I’ve told that kid— — 
clothes"; "to mow the grass"; 
at a decent hour"; ^ 
stereo so loud”; 


door"; etc.) -" To the behavior 


girl named Shirl 


kitchen generally piled all the plates i Who was Working in the 
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one particular area after drying them. The author decided to use so- 
cial approval to reinforce putting the plates and dishes in one area 
and the cups and utensils in another area. After each meal, the au- 
thor faithfully stood around the kitchen ignoring Shirley when she 
put everything in one pile, but smiling and nodding his approval 
when she put the articles in appropriate separate piles. Very little 
progress occurred over several meals, and the author could see that 
the training process was probably going to be anything but rapid. At 
about this time, one of the nurses came into the kitchen and asked 
the author what he was trying to do. After he told her, she immedi- 
ately said, “Oh, if that’s all you want, that’s simple. Shirley, from 
now on, put the plates and dishes here and the cups and utensils 
over there.” From then on, Shirley did just that. The moral is obvi- 
ous: if you want someone to do something, first try telling him. It 
may not always work, but when it does, it takes much less time and 
effort than painstakingly waiting for the behavior to occur before you 
reinforce it. Of course, reinforcement should be applied just the same 
in order to ensure the maintenance of the behavior at a high level. 

An even more flagrant failure to use instruction has been noted 
in more than one university professor we know of who teaches be- 
havior modification. These individuals rely exclusively on extinction 
when they are busy and do not wish to be disturbed by students. 
They simply ignore any student who tries to talk to them. This has 
the desired effect, in that the verbal behavior of students trying to 
talk to them usually extinguishes. But putting a "PLEASE DO NOT 
DISTURB” sign on their office door would probably achieve the same 
effect more quickly and create less hostility in the students. An in- 
teresting example of how added instructions may improve respond- 
ing to a reinforcement program was reported by Glynn and Thomas 
(1974). They were asked to devise a reinforcement program that 
would help a teacher of a class of thirty-four third graders. Nine of 
the children posed special problems of inattention and poor in-seat 
behavior. These children frequently argued, shouted, hit and kicked 
other kids, banged furniture, and left the classroom without per- 
mission. Glynn and Thomas decided to study the children during an 
oral and written language lesson from 9:30 to 10:20 every morning, 
and to take a baseline of "on-task" behavior of these children. On- 

k behaviors were (1) during teacher instruction, to remain silently 
i 's seat, and look at the teacher; and (2) during work periods to 
in mie to: draw a picture, or perform any other activity prescribed 
eee a i During ten days of baseline observations, the nine 
d nin children were on task just less than half the time (overall av- 
E. - 49.6 percent). The teacher then introduced an interesting sys- 
rd the ildien. This system included self-assessment and self- 
em E of desirable behavior, as well as self-determination and 
S ruin idc of reinforcement. The children were each given a 
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ten-by-twelve-inch card with several rows of squares on it, one row 
for each day of the week, and the definitions of on-task behaviors 
were explained to them. The children were told that a “beep” would 
be heard several times throughout the lesson, and that if a child con- 
sidered herself to be on-task at the moment of the beep, she should 
place a check in one of the squares. The children were then told that 
at the end of the lesson they would be able to cash in each check for 
one minute of free play time in a nearby reinforcer room that con- 
tained a variety of games and toys. A noise generator was set to emit 
beeps at an average rate of once every three minutes. Data were taken 
by observers who recorded the on-task behavior of the nine problem 
children without their knowledge. These data show 
dure led to an increase in the on-task behavior 
children to an overall average of 69.8 percent 
cent improvement over baseline). After ten days of this procedure, 
the conditions were changed back to baseline for an additional ten 
days, during which the average on-task behavior of the nine problem 
children dropped to 50.78 percent. 

Although this self-control program led to some improvement, 
the problem children still spent 30 percent of their time in off-task 
behavior during the program. Glynn and Thomas identified two pos- 
sible causes. First, the schedule of beeps may have been too high 
(that is, once every three minutes, on the average, may have been too 


infrequent). Second, the children often appeared confused when the 
teacher changed from one task to a 


ed that the proce- 
of the nine problem 
(approximately a 20-per- 


LOOK AT THE TEACHER 
STAY IN YOUR SEAT 
BE QUIET 


On the other side, in green letters, was: 


WORK AT YOUR PLACE 
WRITE IN YOUR BOOKS 
READ INSTRUCTIONS ON THE BLACKBOARD 
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MODELING 


in the on-task behavior of the nine problem children to 91.11 per- 
cent. Although it is not possible to isolate the relative contributions 
of the new schedule of beeps and the added instructions to the im- 
proved performance, the author's casual observations indicated that 
the instructional chart eliminated the confusion about self-recording 
that the children had shown in the earlier phase. 

Here are some general guidelines for the effective use of instruc- 
tion. 


1. Instruction should be within the understanding of the individual to 
whom it is applied. 
2. Instruction should specify the behavior to be engaged in. 


3. Instruction should specify contingencies involved in complying (or not 
complying) with it, and these contingencies should be applied con- 


sistently. 
4. Complex instruction should be broken down into easy-to-follow steps. 


5. Instruction should be sequenced so that it proceeds gradually from very 
easy to more difficult behavior for the individual being treated. 


6. Instruction should be delivered in a pleasant, courteous manner. 
7. Use fading as necessary to phase out instruction if you want other stimuli 
that are present to take control of the behavior. 


Modeling is a procedure whereby a sample of a given behavior is 
presented to an individual in order to induce him to engage in a 
similar behavior. Like instruction, it can be quite powerful. You may 
convince yourself of this by performing the following simple experi- 


ments: 


1. For an entire day speak only in a whisper, and note how often people 
around you also whisper (this is a good experiment to try when you have 
laryngitis). 

2. Yawn conspicuously in the presence of other people, and note their fre- 
quency of yawning. 

3. Stand looking into a window of an empty department store for an hour, 
and note how many people stop and also look in the window. 


In each case, compare the data obtained with data obtained un- 
der comparable circumstances when the behavior is not being mod- 
eled. 

Like instruction, modeling is in such common use by the gen- 
eral public that few people (other than behavior modifiers) think of it 
as a behavior modification procedure.? Parents, for example, use it 
rather unsystematically, but quite effectively in many cases, to teach 
language and other behavior to their children. Behavior modifiers use 
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it in much the same way, although more systematically, to teach a va- 
riety of behaviors, as described in Chapter 8. 

Modeling often involves having an individual observe a peer 
who is performing appropriately. For example, consider the case of 
an extremely withdrawn nursery-school child who almost never in- 
teracts with other children. This behavior problem could be treated 
with shaping. A method that can perhaps produce faster results, 
however, is to have the child observe several instances of another 
child joining in the activities of a group of children. The group 
should be responding to the model in a reinforcing manner (for ex- 
ample, by offering her play material, talking to her, and smiling). To 
insure that the modeling occurs under opportune circumstances and 
in a suitable fashion, it may be necessary to instruct certain children 
to perform as models and to instruct the children in the group to be- 
have in a conspicuously reinforcing manner to the models. It is 
sometimes convenient and effective to film or video-tape a number of 
such episodes for viewing by socially withdrawn children.* The pre- 
sentation of modeling scenes through film, videotape, and other 
media is called symbolic modeling. Studies show that this type of 
modeling can sometimes be as effective as the real thing (see, for in- 
stance, Masters and Driscoll, 1971). 


Modeling is frequently used with adults who 
veloped behavioral repertoires. The 


Client: By m. way (pause) | don't Suppose you want to go out Saturday 
night? 


Therapist: Up to actually asking for the d 


Client: That sounded 


Therapist: Why don't you try it. 
Client: You know that movi 


Therapist: Well, that certainl 


"See O'Connor (1969) for a d 


etailed descripti f a 
“The excerpt is from Rimm a Dion of the effectiv 


nd Masters (1974. aon e use of this procedure 
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Client: I'd like to see the show at the Varsity, Saturday, and, if you 
haven't made other plans, I'd like to take you. 
Therapist: Much better. Excellent, in fact. You were confident, forceful 
and sincere. 


Here are some general guidelines for the effective use of mod- 
eling. 
1. The complexity of the modeled behavior should be suitable for 
the behavioral level of the client. 
Combine instructions with modeling.* 
3. Reinforcement should be given for correct imitation of the mod- 
eled behavior.? 
4. The modeling episode should be sequenced from very easy to 
more difficult behavior for the individual being treated. 
The modeling scenes should be as realistic as possible.5 
6. Use fading as necessary so that stimuli other than the model can 
take control over the desired behavior. 


N 


in 


PHYSICAL GUIDANCE 


Physical guidance is the application of physical contact to induce an 
individual to go through the motions of the desired behavior. Some 
familiar examples of guidance are a dance instructor leading a pupil 
through a new dance step; a golf instructor grasping the novice’s 
arms and moving them through the proper swing and follow- 
through; and a parent holding a child’s hand while teaching her to 
cross the street safely. Guidance is always only one component of a 
teaching procedure. Both the dance instructor and the golf instructor 
will also use instruction (they will tell the student what to do and 
give her ^"pointers"), modeling (they will demonstrate the appro- 
priate physical postures and motions), and reinforcement for correct 
responses Or approximations to them (such as "Excellent!" or "Much 
better!). Likewise, the parent teaching her child to cross the street 
safely will use instruction (for example, by saying, "Look both 
ways”) and modeling (for example, by looking both ways in an exag- 
gerated manner). 

Some uses of guidance in behavior modification programs were 
given in Chapter 8—for example, using guidance and fading to teach 
a child to touch his head upon request. Guidance is generally used in 
procedures for teaching instruction following and model imitation, so 
that instruction and modeling can then be used to establish other be- 
haviors. For example, in one procedure for teaching instruction fol- 
lowing, a child is placed in a chair opposite the teacher. At the be- 
ginning of a trial the teacher says, "Johnny, stand up" and then lifts 
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the child onto his feet. Reinforcement is then presented immediately, 
as though the child himself had performed the response. Next, the 
teacher says, “Johnny, sit down,” and grasping the child’s shoulders 
the teacher gently but firmly presses him down on the chair. Again, 
immediate reinforcement is presented. The process is repeated over 
numerous trials while guidance is faded out (see Kazdin and Erick- 
son, 1975). After this set of instructions is learned, the behavior mod- 
ifier teaches another set (such as "Come here" and "Go there”), us- 
ing a similar procedure. Less and less fading may be required to 
teach successive instructions, until eventually even fairly complex in- 
struction-following behavior can be taught with little guidance. 

As in teaching instruction following, the teacher who uses guid- 
ance to teach model imitation starts with a few simple imitations 
(such as touching one’s head, clapping one’s hands, tapping the 
table, standing up, and sitting down) and adds new imitations as the 
previous ones are learned. This can involve teaching instruction fol- 
lowing and model imitation at the same time, depending on the ver- 
bal stimuli presented. For example, the individual will learn to follow 
an instruction to imitate behavioral displays if the teacher says "Do 
this" while modeling the behavior. This might facilitate the devel- 
opment of generalized imitation, whereby the individual imitates 
completely new behavior at the first opportunity to do so.’ 

Another common application of guidance is in helping individ- 
uals to overcome fears. For example, helping a person who is terrified 
of water might involve gradually leading her by the hand into the 
Shallow end of a swimming pool and supporting her while she floats. 
The least fear-provoking aspects of a situation should be introduced 
first, and the more fear-provoking aspects later in a very gradual 


manner. One should never try to force an individual to do more than 
she feels comfortable doing.* The more fearful 


gradual the process should be. ( 
tematic desensitization see pp 


the person is, the more 
Note that this process extends sys- 
- 214-218—to the natural environ- 
ment. For this reason it is sometimes called in vivo desensitization.) In 
the case of a very fearful individual one may have to spend many 
sessions simply sitting with her on the edge o 


5 wil f the pool. 
Some general guidelines for the effective use of guidance are as 
follows. 


1. Reinforcement should be given immediatel 
pletion of the guided response. "EV. OSE P MRE spins 
2. Guidance should be sequenced 


radually fı iffi 
behavior for the individual being Best. DICERE Rt ii dificult 


3. The stimuli you want to eventuall 
spicuously present during guidanc 


4. Use fading as necessary so t ; : 
navic, ry hat other stimuli can take control over the be- 


y control the behavior should be con- 
e. 
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Largely because of our similar histories of reinforcement and punish- 
ment, there are numerous situations and occasions in our society that 
control similar behavior in many of us. The interiors of certain public 
buildings, such as churches, museums, and libraries, tend to sup- 
press loud talking. Parties tend to evoke socializing and jovial, care- 
free behavior. Catchy melodies prompt humming and singing, and 
strident march music tends to incite participation in a foot-stamping 
parade. The assorted stimuli associated with Christmas induce cheer- 
fulness, friendliness, and gift buying. 

We use the term situational inducement to refer to the deliberate 
use of situations and occasions to control behavior. Such techniques, 
like others we have discussed, no doubt predate recorded history. 
Ceremonious gatherings involving singing and dancing probably 
served to strengthen “togetherness” in ancient tribes, just as they do 
today in almost all cultures. Monasteries and convents have been 
used for centuries to promote asexual religious behavior by provid- 
ing an environment conducive to reading religious texts and medi- 
tating, and by restricting opportunities for the sexes to interact. 
Supermarkets and department stores use many situational fea- 
tures to induce buying. Among these are the attention-evoking man- 
ner in which the products are displayed, and pictures showing the 
products in an attractive way. Fine restaurants provide a relaxing at- 
mosphere so as to optimize eating behavior. If the restaurant be- 
comes crowded and people are waiting for tables, fast music may be 
played to induce rapid eating. 

Examples of situational inducement can also be found in the 
home. Many people have unusual objects in their living room that 
function as “conversation pieces.” If the conversation lags when 
guests are present, a rare decorative vase may stimulate someone to 
initiate a new line of conversation with a remark such as, "Oh, 
where did you get that beautiful Ming vase?" or, “I saw one just like 
it on my recent trip to China." Such fragile conversation pieces tend 
also to induce undesirable handling behavior, especially in children. 
When this happens, the host may use situational inducement by 
quickly handing the potential offender something less expensive, 
such as a toy or a drink. 

Situational inducement has been used in a number of imagina- 
tive and effective ways in behavior modification programs to help in- 
crease or decrease target behaviors, or to bring them under appro- 
priate stimulus control. Examples can be conveniently discussed 
under four somewhat overlapping categories: (1) rearranging the 
existing surroundings; (2) moving the activity toa new location; (3) 
relocating people; and (4) changing the time of the activity. 
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Rearranging the Existing Surroundings 


An interesting example in the first category occurred in a case 
reported by the well-known behaviorist Israel Goldiamond (1965). 
Goldiamond was consulted by a married couple who were having a 
problem in their relationship. When the couple were together in the 
house, the husband could not refrain from screaming at his wife over 
her once having gone to bed with his best friend. One of the goals 
that was decided upon, therefore, was to replace screaming with civ- 
ilized conversational behavior. Goldiamond reasoned that the hus- 
band’s screaming had probably come under the control of the $s in 
the home environment and that one way to weaken the behavior in 
that situation would be to change those SPs. He therefore instructed 
the couple to rearrange the rooms and furniture in the house to make 
it appear considerably different. The wife went one step further and 
bought herself a new outfit. Goldiamond then provided for the rein- 
forcement of civilized conversation in the presence of these new S"s 
which were not associated so strongly with screaming (how he did 
this is explained more fully below). It was important to do this as 
quickly as possible, because if Screaming occurred too often in the 
presence of the new SPs, it would become conditioned to them just as 
it had been conditioned to the old $s. 

Another example of rearranging the existing surroundings is al- 
tering the furniture and other items in one's room in order to pro- 
mote better and more persistent studying beh 
example, improve the lighting, clear one's desk 
move the bed as far as possible from the desk, a 
ing away from the bed. Better yet, if possible, 
have the bed in the same room as the desk bec 
for sleeping. In order to prevent nonstudy beha 
ditioned to the new stimuli, one should engag, 
havior when in the rearranged environment (s 

Letter writing is a behavior that is diffi 
it involves a long delay of reinforcem 


to get a return letter). One wa 
however, 


avior. One might, for 
of irrelevant material, 
nd have the desk fac- 
one should not even 
ause the bed is an S” 
viors from being con- 
e only in studying be- 
ee Goldiamond, 1965). 
cult to maintain because 
ent (it takes at least several days 
à y to strengthen your tendency to write, 
er, is to place before you a picture of the person to whom you 
are writing. This is another example of rearranging stimuli to control 
behavior. (Other examples are shown in Figure 15-1). 


Moving the Activity to a New Location 
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to go to a place that would induce civilized conversation. It was 
hoped that this behavior would continue until they returned home, 
and would then come under the control of the new SPs in the home. 
To quote from Goldiamond's report (1965, p. 856): 


Since it was impossible for [the husband] to converse in a civ- 
ilized manner with his wife, we discussed a program of going 
to one evening spot on Monday, another on Tuesday, and an- 
other on Wednesday. 


“Oh,” he said, “you want us to be together. We'll go bowling 
on Thursday." 


“On the contrary," I said, "I am interested in your subjecting 
yourself to an environment where civilized chit-chat is main- 
tained. Such is not the case at a bowling alley,” 


to that card. The $20 was to be used to pay the waitress on 
Thursday, at which point he was to start the "farm" discussion 
which hopefully would continue into the taxi and home. 


Purpose, although any other well-] 
ing space would be suitable. Dependi 
study behavior in the Student's repertoire 
combine relocating the activity with som 


discussed in Part II of this text. For severe deficiencies, behavior in- 


ediatel : oes not become conditioned to the 
stimuli in the studying area (see Fox, 1962). Similarly, the husband in 


y Goldiamond was instructed to 
Specially designated “sulking” stool 
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whenever he was in the house and felt a tendency to sulk—thi 
being a behavior that was threatening the recently strengthened c 2 
versational behavior after screaming had been eliminated D 


Relocating People 


The third category of situational inducement was not illustrated 
in Goldiamond's case study. The procedures used in that case were 
effective; therefore, a separation of the spouses was not necessa 
Although relocating the participants is generally a measure of last = 
sort when dealing with individuals who wish to maintain their re- 
spective relationships, it is sometimes the most practical tactic in 
other circumstances. If you just cannot get along with Sam Jones, and 
there is no particular reason for you to associate with him anyway 
then why try to change his behavior and/or yours in order to make 
the two of you more compatible? Both of you will probably be hap- 
pier respecting each other from a distance. 

Classroom teachers of small children often change seating ar- 
ments in order to relocate pupils whose close proximity leads to 
s types of disruptions. This is usually much easier than design- 
rrying out reinforcement and/or punishment programs in 
iminate undesirable interactions, and the end result may 


range 
variou 
ing and ca 


order to el 
be just as effective, or more $0. 


Changing the Time of the Activity 


The final category of situational inducement involves taking ad- 
vantage of the fact that certain stimuli and behavioral tendencies 
change predictably with the passage of time. For example, two sexual 
ers may find that sexual activity is better for them in the morn- 
night when one of them is “too tired." Changing the time 
y has been used effectively in weight-control programs. 
People who cook for their families sometimes put on excess weight 
by “nibbling” while preparing meals and then sitting down for a 
full-course dinner. Rather than foregoing dinner with one's family, a 
partial solution to this problem is to do the preparation, except for 
the actual cooking, shortly after having eaten the previous meal, 
the tendency to eat is still relatively weak (see Ferster, Nurn- 


partn. 
ing than at 
of an activit 


while 
berger, and Levitt, 1962). 
Situational inducement covers a very broad set of procedures 


Its use, therefore, is considerably less straightforward than that of the 
other methods discussed in this chapter. In short, a good deal of 
imagination is typically required if it is to be used effectively We 


suggest the following guidelines: 
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1. Insofar as this is practical, arrange for the individual of concern to be ex- 


posed to locations and environmental arrangements that already control 
the target behavior in the desired way, and to avoid locations and ar- 
rangements that do not have this control. 


. Determine whether it is necessary or desirable to extend the behavior to 


situations that do not presently exert desirable control over the behavior, 
and, if it is, take appropriate steps to bring this about. 


. Make sure that undesirable behavior never occurs in the presence of situ- 


ations introduced to control the desirable behavior. 


Study Questions 


2. A teacher of a second-grade class compl 


3. Explain (in terms of 


4. Can you think of any humorous ex 
5. Discuss critically the attitud 


6. In regard to the GI 


for examination purposes 


- What basic procedures discussed in the first thirtee 
might be used to: 
a) increase an infrequent behavior? 
b) decrease an excessive behavior? 
c) develop a behavior that never occurs? 
d) get a desired behavior to oi 
uli? 


n chapters of this text 


ccur in the presence of appropriate stim- 


ains to you, “When I tell the chil- 
hey never listen to me." Describe 


ting with respect to that instruc- 
class. 


dren to stay in their desks and work, t 
the contingencies that are likely opera 
tion from the teacher to the kids in the 


and extinction) why the tone of voice of 


amples from your experience that 


demonstrate instructional control of behavior? 


€ a number of ear] i ifi d 
towards instruction. TU Ner Srt tus 


ynn and Thomas study on Ps ag ropa Tm 
classroom situation: y added instruction in 


a) what two examples of stimulus control w 
a ; ere GI m 
suring during the first baseline? iiio ag d ai 


b) what i m i 

) iid e the schedule of reinforcement during the first self-control 
c) did the first self- i 

c) po e first self-control phase include a token System? Why or why 


d) explain how the added instructions related to the four questions one 
should ask when selecting an S" (see p. 110). j 


State and discuss a major implication of the Glynn and Thomas study 
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10. 
11. 


15; 


. What is meant by physic 


. Identify 


Describe two recent situations in which i 
A o! 
eling to emit a behavior. peur eren E EEEL py moda 
Describe the specific steps you mi i 
ght go through in usi i 
overcome the extreme withdrawal behavior a a ee 
who never interacts with other children. Identify the alae! ri 2) n 
procedures being applied in your program. Enncipiesano 
Describe an example of modeling that appears in Chapter 8 
In the dialogue between the client and the i A 
E lae $ e thera i 
client’s difficulty in asking for dates, briefly S sonering Me 
a) how modeling was involved. 3 i 
b) how instructions were involved. 
c) how shaping was involved. 
What is meant by symbolic modeling? Describe h i i 
d : A t ow th i 
volved in teaching a child to fear snakes. is might beta 
al guidance? How does it diff 
s er from 
prompting? (See pp. 128-9.) - nido 
a behavior that you were recently influenced 
4 : x to perform as a re- 
sult of instructions, modeling, and physical guidance. D i : in 
tactic was involved. b Miescrane BOM AEACh 
What do we mean by the term situational inducement? Which term 
given previously in this book has essentially the s i 
oe y ame meaning (See p. 
What are the four proposed categories of situational inducement? 
Give an example from the text of each of the four categories of situational 


inducement. 
Give an example from your o 
of situational inducement. 
State a difference and a similarity betweer i Ps 
location and relocating people. 5 n moving the activity to a new 
For each of the following examples, identify t = y 
inducement in which it might best be placed ae lace 
a) On Saturday afternoon, an exercise buff can't seem to “ dm up th 
ergy" to lift his weights. In order to increase his likelihood of ihneens 
lifting, he places the weights in the center of the den (where decli 
ally exercises), turns on the TV to the Saturday afternoon w ewe 
matches, and opens his Muscle Beach magazine to the Mr. pari 
. a 


centerfold. 

b) It is said th 
habits in his st 
not bring them 
69). 

c) In order to q 
members and 

d) Another exercise bu 
ing to bed. Alas, 
paved with good i 


wn experience of each of the four categories 


at Victor Hugo, the famous writer, controlled his work 
udy by having his servant take his clothes away and 
back until the end of the day (Wallace, 1971, pp. 68- 


uit drinking, an alcoholic surrounds hi i 

stops seeing his old drinking Pur ng DITS: 

iff has decided to jog a mile every night before go- 

“the road to hell [or perhaps to heart aie 

ntentions." Late nights, good TV, wine with di S 
ner, and other events take their toll. Three months later, our “exe mos 
buff" is still fat and out of shape because of many missed Ses 
nights. He therefore changes the routine and begins joggin edu. 
immediately upon arriving home and before eating dinner zia a 

e) After many interruptions while working on this book = the u r- 
sity, the authors began working at one of their homes dd 
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21. According to the proposed guidelines for the use of the instruction, mod- 
eling, and physical guidance: 
a) what behavioral principle is used with all three procedures? 


b) what two other behavioral procedures are likely to be used with all 
three procedures? 


Study Exercises 


(to be practiced by the reader) 


1. Outline a program that a parent might follow to teach a two-year-old child 
to respond consistently to the instruction “Please bring me your shoes.” 
Indicate how your program might use instructions, modeling, and guid- 


ance, and how it follows the guidelines for the effective application of 
each. 


2. Select two behaviors from the following list: 
a) doing the dishes immediately after a meal 


b) getting up when the alarm rings 
c) feeling happy 


d) cleaning up your bedroom twice per week 


f) decreasing your cigarette smoking 


For each behavior, describe how you might influence the behavior by 
combining at least three of the followin 


Self-Modification Exercise 


(to be practiced by the reader) 


€ TER i t te how each is involved: instruc- 
tions, modeling, guidance, e existing surroundings, moving 
the activity to a new location People, and changing the time: of 
the behavior. 


isti her than behavioristic. Par- | 
(Continued) | 
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ticularly in formal education, it is often held that instruction involves 
"transmitting" or "communicating" knowledge, ideas, and concepts 
from the “mind” of one individual (the teacher) to that of another (the 
student). From a behavioristic point of view, however, even the teaching 
of complex verbal concepts is no different, in principle, from instructing 
someone to engage in a manual skill, such as driving a car. Consider. 
for example, the following statement by Skinner (1974, p. 121): ; 


Much of education is instruction in verbal behavior. The student is told 
how to "use words" rather than how to use an accelerator or brake. In 
neither case is he given knowledge; he is told how to behave. The instruc- 
tion given by a labeled picture often works very quickly; the viewer knows 
at once what the object is called and what the label means. A definition is 
a seemingly more internal form of instruction, but its effect is simply that 
one verbal response is now used interchangeably with another. 


That instruction alone is not always effective has been empirically. 
demonstrated numerous times. O'Leary, Becker, Evans, and Saudargas 
(1969) found that rules did not alter disruptive classroom behavior, 
whereas token reinforcement for desirable behavior decreased the un- 
desirable behavior. Phillips (1968) reported on a token system used in 
Achievement Place, a residential unit for "predelinquents" (boys who 
were judged guilty of minor offenses and deemed likely to advance to 
more serious crimes). One of his findings was that instructions (for ex- 
ample, "Stop that kind of talk") did not effectively reduce aggressive 
statements (such as "I'll kill you") by the boys. However, aggressive 
statements were markedly reduced when fines (the loss of tokens) were 
charged for them. In another study conducted with boys at the same 
residential unit, Bailey, Wolf, and Phillips (1970) found that giving them 
a number of classroom rules to follow (such as "Do not talk without 
permission" and "Do not look out the window") did not effectively de- 
crease the specified undesirable behaviors. However, the undesirable 
behaviors were markedly reduced when the boys could earn tokens for 
engaging in them less than 10 percent of the time. 


Historically, learning by imitation has been given an important place 
in a number of different psychological theories, not just behavioristic 
ones. In Freudian (psychoanalytic) theory, for example, a male child 
typically develops certain "male" behavior patterns through identifica- 
tion with his father, whereas a female child develops female behavior 
patterns through identification with her mother. Thus, for example, 
the absence of a strong male figure with whom to identify could (in the- 
ory) lead to feminine traits - even homosexuality—in a boy who identi- 
fies excessively with the mother. Gestalt psychologists considered 
imitative learning to be innate in higher species, and attempted to 
show, for example, that chimpanzees could learn to solve problems by 
watching other chimpanzees solve them. More behavioristically oriented 
psychologists, however, have tended toward the view that imitation is it- 
self a learned behavior. 

There are several processes by which imitative behavior might be 
learned. First, an individual is frequently reinforced when he performs 
the same actions that another individual performs; hence, other people's 
actions tend to become S?s for engaging in similar actions. (For example, 
a child who watches someone open a door to go outside receives the 
reinforcement of going outside when he performs the same action.) 
Second, to the extent that other people are reinforcing to us, their actions 
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acquire conditioned reinforcing properties; hence, we receive con- 
ditioned reinforcement when we perform the same actions. A third 
possibility is that once we have learned to imitate simple responses, 
we can then imitate more complex behaviors, provided that these are 
composed of the simpler responses. (For example, once an individual 
has learned to imitate "al," “li,” "ga," and "tor" as single syllables, 
or as units of various words, she can then imitate the word “alligator” 
the first time she hears it [Skinner, 1957]). A fourth possibility is that 
imitative behavior is not just a set of Separate stimulus-response re- 
lationships, but is itself an operant class of responses. In other words, 
it is possible that once a person is reinforced for imitating some behav- 
iors, he will then tend to imitate other behaviors, even if they contain no 
elements in common with the imitative behaviors that were reinforced. 

Regardless of theoretical orientation, there is no doubt that model 
imitation is an important factor in human behavioral development. Ex- 
actly how, and under what conditions, it influences behavior is an im- 
portant practical question that is receiving intensive experimental study. 
Experimental psychologist Albert Bandura and his co-workers have 
contributed greatly to our understanding of this important aspect of hu- 
man behavior. (For a review of Bandura's and others' studies in this 
area, see Bandura, 1969.) Modeling has also been used effectively as 
a therapy technique (for reviews, see Bandura, 1971; Rachman, 1972). 


That instruction combined with modeling can be more effective than 
modeling alone is illustrated in 


and Pinkston (1975). The patient 
experienced chronic difficulties i 


; phases: (1) baseline; (2) modeling 
alone; (3) modeling plus focused instruction: Ie 


[ / he patient. For example, the patient 
would ask the therapist, playing the role of the supervisor, for a raise, 
to which the therapist wouid reply, 

raise. Or the therapist, playing the role of the foreman, would blame 
the patient for a mistake that was not his fault. The patient's sub- 
sequent behavior was measured with respect to four categories: (1) 
ae T E Comments; (3) compliance with unrea- 
sonabie demands; and (4) a request for th i 

ei hs q e other person to change his 

During the modeling-alone Sessions, the i 

y J : iK ] patient was shown a 
video-tape in which the thera modeled desirable BENESI ORENA 
was defined as increased requests 


to the patient other than "t 
during each scene and then 
before viewing the next m 


showed considerable improvement in the beh 
baseline. 


comply with unr 
(Continued) nreasonable 
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requests; (3) on the next three sessions to focus on 

avoided making irrelevant comments; (4) on the final ee pe 
notice how the model requested the other person in the scene to 
change his behavior. In each case, the target behavior improved when 
instruction was added to the modeling procedure. The follow-up phase 
showed that the improvements were maintained over a period of six 


months. 


For example, Lovaas, Berberich, Perloff, and Schaeffer (1966) used 
reinforcement to establish vocal imitations in retarded children. They 
then showed that when reinforcement was given to the children only 
when they did not imitate correctly, the number of correct imitations 
decreased. Moreover, Gibson, Lawrence, and Nelson (1977) demon- 
strated that modeling, instructions, and feedback for teaching social re- 
sponses to developmentally disabled adults were more effective than 
modeling alone, or instructions and feedback alone. 


This rule follows, of course, from the principle of stimulus general- 
ization, discussed in Chapter 11. 


Generalized imitation occurs when an individual, after learning to 
imitate a number of behaviors (perhaps with some shaping, fading 
guidance, and reinforcement), learns to imitate a new response on the 
first trial without reinforcement. An example of the study of generalized 
imitation with severely retarded children is the classic experiment by 
Baer, Peterson, and Sherman (1967). They used shaping, guidance, and 
fading with reinforcement to teach a severely retarded child to imitate 
the teacher when the teacher said “Do this" and simultaneously modeled 
some behavior. After seven responses (such as raising the left arm and 
tapping the table with the left hand) were learned, one of the children 
correctly imitated tapping the arm of the chair when that response was 
first modeled, even though that response was not reinforced. This was 
an example of generalized imitation. 


Not all behavior therapists agree with this view. For example, if a 
client has a strong fear of something (such as looking out from high 
places), some therapists encourage the client to form very vivid images 
of specific situations that cause the fear (looking down from the top of a 
very tall building, feeling dizzy, feeling more and more anxious, and so 
forth). It is assumed that this approach will extinguish the anxiety reac- 
tions of the client to the scenes imagined in the therapists office, and 
that the results will hopefully generalize to the real world. This ap- 
proach of having a client imagine himself in a very fearful and anxieiy- 
producing situation is called implosive therapy (Stampfl and Levis, 
1967). However, the literature does not indicate this to be a generally 
highly successful approach (Morganstern, 1973, 1974), and we would 
not recommend its use. Also, even an implosive therapist presumably 
would not throw a fearful nonswimmer into twenty feet of water; he 
would have him only imagine being thrown in. 


Study Questions on Notes 


1. Compare and contrast the behavioristic and mentalistic views of in- 


struction. 
(Continued) 
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In our experience, the majority of problems referred to behavior 
modifiers are phrased in terms of behavioral excesses. This is prob- 
ably due largely to the habitual way in which the average person 
thinks about behavior problems. That is, people tend to focus more 
on what is “wrong” about what a person is doing rather than on 
what they would like that person to be doing instead. “Susie keeps 
running around the room during class” and “Johnny just sits staring 
into space" are common complaints that teachers make. 

Other behavior modifiers have also noted this tendency. Green- 
spoon (1976, p. 176), for example, commented, “The specification of de- 
sired behaviors . . . is not an easy task. The difficulty is well illustrated 
by the parent who spent 30 minutes telling the psychologist all the be- 
haviors that her son emitted that she did not like. When asked what she 
wanted the boy to do, she replied ‘Well, I just want him to be a good 
boy.' When asked what behaviors constituted a ‘good boy,’ she con- 
ceded that she didn't know and would have to think about it." 

When referrals are presented in this way, the skillful behavior 
modifier does not automatically think, “Aha! Here's a behavioral ex- 
cess to be decreased." Rather, she asks the teacher or parent, "What 
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is the appropriate behavior to increase in this situation?" Through 
such examination, it may be found that the teacher, for example, is 
really concerned about Susie's and Johnny's "undesirable" behaviors 
only to the extent that they keep these children from engaging in 
more desirable behaviors (such as completing their classwork assign- 
ments). So the behavior modifier would reformulate the problem in 
terms of increasing a behavior that doesn't occur frequently enough 
rather than decreasing a behavior that occurs too frequently (see 
Goldiamond, 1975). 

Although one should always think in terms of increasing desir- 
able behavior, it is sometimes necessary to focus also on decreasing 
undesirable behavior. This does not mean, however, that the first 
thought that should come to mind is to use extinction or punish- 
ment. As explained in Chapters 3 and 12, these procedures have a 
number of drawbacks. They frequently produce undesirable side ef- 


fects, and they frequently require many trials before the undesirable 
behavior decreases to zero (or at least to a 


available. Additionally, 
placed in a time-out room 


time-out room. On the other hand, imagine the same teacher on a 


day when he's in a bad mood. He yells, “No! Come on!" grabs the 


zr by the scruff of his neck, and “bounces” him off to the time-out 
room. 


ponent of extinction, togeth 
involve partial rather than c 


the chapter, we list guidelines indicating the order in which we be- 


lieve the methods described in this and the preceding chapters 
should generally be considered in selecting a method to decrease a 
particular undesirable behavior. 


IT HELPS TO CONSIDER THE CAUSES OF BEHAVIOR 
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In Part II of this book, we gave many examples of how ignorance of 
the basic principles and procedures of behavior modification can lead 
to behavior problems. The knowledge thus generated about the 
causes of those problems can clearly be useful: it can help to prevent 
those problems. Ultimately, prevention may be the most important 
reason for considering the causes of behavior. 

Even after a problem behavior has been detected, however, 
knowledge of the causes of that behavior can often help in deciding 
how to deal with it. For example, if the sources of reinforcement for 
the behavior can be identified, it may be possible to alter or elimi- 
nate them so that extinction may proceed. Sometimes, however, con- 
sideration of the causes will indicate that extinction is not the best 
strategy because the sources of reinforcement cannot be effectively 
changed —at least not in the situation in which the behavior is occur- 
ring. For example, the individual may be receiving reinforcement 


from his peers, and it may not be feasible to get them to stop rein- 


forcing him. 
Due consideration to the causes of behavior may also lead one 


to the appropriate conclusion that specialists more competent than 
oneself should deal with the problem. For example, if a person is 
troubled by thoughts of suicide, the novice behavior modifier should 
not attempt to extinguish that behavior on the reasoning that "he's 
just trying to get my sympathy; well, I'll withhold it and he'll stop 
talking that way." Obviously, such an approach could prove dis- 
astrous. It would be much more ethical to refer the person to an ex- 
perienced behavior therapist, who is qualified to identify the sources 
controlling the behavior and to undertake appropriate measures to 
counteract those sources. 

Likewise, the novice behavior modifier should not attempt to 
eliminate behaviors that may have medical causes. Sneezing, vomit- 
ures are obvious examples of behaviors for which the 
f extinction or punishment might be as ridiculous as 
dvice from Lewis Carroll: 


ing, and seiz 
application O 
this tongue-in-cheek a 


Speak roughly to your little boy, 
And beat him when he sneezes: 
He only does it to annoy, 
Because he knows it teases. 


It is true that cases of almost continuous sneezing for which there are 
no known medical causes have been reported. Vomitting controlled 
entirely by nondeliberate reinforcement is not uncommon in in- 
stitutions for the retarded. We have also observed retarded children 
whose “seizures” are not true seizures at all, but rather very realistic 
fake seizures shaped by the attention they attract from attendants 


nurses, and doctors. However, it would be unethical for any behavior 
modifier to attempt to treat such cases without first consulting the 
appropriate medical authorities.! 


ALTERNATIVE STRATEGIES FOR DECREASING BEHAVIOR 
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Situational Inducement 


In Chapter 15, we described four somewhat overlapping categories of 
situational inducement: rearranging the existing surroundings, 
changing the activity to a new location, relocating people, and chang- 
ing the time of the activity. As was illustrated by many of the exam- 
ples in that chapter, it is frequently possible to decrease behavior by 
identifying stimuli that already control desirable alternative behav- 
iors, and using these stimuli according to one or more of the situ- 
ational-inducement procedures (for example, recall the efforts of 
Goldiamond to decrease a man’s screaming at his wife). 

If an undesirable behavior occurs in response to particular stim- 
uli in very specific situations, it is sometimes possible to eliminate 
the behavior simply by changing the stimulus and eliminating the 
Opportunity to emit the behavior. Consider the ca 
eight-year-old mildly retarded b 
class.* His teacher, Ms, Millan, reported to one 


giving wrong answers, Edward would burst out wi 
ah.” Needless to say, 


lan reported that on 


"The details of this case were provided by a student in a behavior modification course 
for resource teachers taught by G, Martin at th 


diis e Winni ivisi pue 
Winnipeg, Manitoba, January-March, 1973. AREPSE enol: Division Na 
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present during these sessions, the behavior apparently was under the 
stimulus control of the presence of the other class members. 

During class, over a two-week period, Ms. Millan asked Edward 
questions to which he knew the answers and gave him a great deal 
of approval for correct answers. Then, over the next two weeks, Ms. 
Millan began fading in slightly more difficult questions, each of 
which she prefaced with a strong prompt, such as, "Now Edward, 
here is a question that's a little difficult. But I'm sure you can answer 
it, and if you can't we will figure out the answer together, won't we 
class." Thus, if Edward eventually did give a wrong answer, he was 
immediately engaged with the teacher and the rest of the class in an 
attempt to figure out the answer. This gave Edward the opportunity 
to receive the attention of the class for desirable behavior, rather than 
for the undesirable Tarzan noises. That, coupled with his recent his- 
tory of receiving reinforcement for giving correct answers, solved the 
problem. The project required approximately a month of careful at- 
tention from Ms. Millan. Thereafter, Edward required no special at- 

order to maintain his good behavior, however, Ms. Millan 


Aen&on. In i 
made sure that she periodically asked Edward questions to which he 


knew the answers. 


Instruction, Modeling, and Role Playing 

Toby, the son of one of the authors, was attending nursery 
school three mornings per week. His parents (Garry and Nickie) were 
somewhat dismayed when Toby frequently reported that he had 
been fighting in school with a boy named Karle. Because of their 
concern, Garry and Nickie approached the nursery-school teacher, 
Mona, and asked if they could come and watch Toby's activities. Sure 
enough, they observed that Toby frequently engaged in rough hous- 
ing with a boy named Karle. They also observed that Toby was not 
the instigator. During certain activities Karle would grab Toby and 
Toby would retaliate. The two children would then begin wrestling 
and playfully rolling along the floor in a boisterous fashion. 

The problem was handled at home by means of a few sessions 
of instruction, modeling, and role playing involving Toby, Garry, and 
Nickie. One evening, Garry instructed Toby as follows: “Toby, let's 
pretend that Nickie is Mona and that we're at nursery school. Okay? 
Let's pretend that you and I are the kids at nursery school. You pre- 
tend to be Karle and I'll pretend to be you. Now, let's pretend that 
we are making animal noises like Mona sometimes tells us to." At 
this point, Nickie, playing the role of Mona, gave the appropriate in- 
structions for the children to get down on the floor and pretend that 

d to make tiger noises. Garry then said, "Now, 


they were tigers an 
Toby, remember you're Karle. What does Karle do when you're mak- 
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ing animal noises?" "He usually comes and tries to pretend he’s eat- 
ing me up like a tiger,” said Toby. Garry replied, "OK, Toby, you do 
that to me." Toby responded vigorously, as though he were Karle. At 
that point Garry said, "Now, Toby, here's what I want you to do 
when Karle does that to you." Garry (playing the role of Toby) imme- 
diately stood up and said, "No, Karle. My dad doesn't like me to 
fight in school. Right, Mona?" To this, Nickie (playing the role of 
Mona) immediately responded with, “Good for you, Toby. Yes, that's 
right." 

After several repetitions of the role playing, the roles were re- 
versed and Toby was instructed to pretend and act as though he 
were "Toby at school." Garry assumed the role of Karle, and Nickie 
continued to play Mona. Over several trials and several different 
"typical nursery school" activities, Garry played the role of an ag- 
gressive Karle and grabbed Toby in an attempt to start to wrestle. 
Toby was prompted to immediately stand up and say, "No, Karle. 
My dad doesn't want me to fight in school. Right, Mona?" After a 
number of trials, Toby's reaction became quite automatic. During a 
period of approximately a week, Toby's fighting with Karle in the 
classroom decreased to near zero. Toby began emitting more desir- 
able classroom behaviors, and in tum r 
from Mona. Six weeks after this progra 
was still under good control. 


eceived more reinforcement 
m, Toby's fighting in school 


Eliminate the Early Component of a Chain 


Sometimes, an undesirable 
havioral chain. It is therefore so 
desirable behavior by elmin 
that leads up to it.? 


Such a case was described to 


behavior is Part of a consistent be- 
metimes possible to eliminate an un- 
ating an earlier component of the chain 


home. Frequently during the day, 


This behavior was highly reinforced, 


After several guided trials, mother was able to initiate the se- 
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quence of behaviors by instructing the child while they were both in 
the kitchen. The guidance and instruction trials occurred over a two- 
day period during which the child was not given an opportunity to 
go into the bedroom on her own. On the start of the third day, the 
child was instructed that anytime she wanted to, when mom was in 
the kitchen, she could get some jewelry, place it in the jar in the 
kitchen, and receive a “treat” from mom. In addition, the mother 
took a polaroid photograph of the daughter putting the jewelry into 
the jar on the kitchen table and placed the picture beside the jewelry 
box in the bedroom. During the next three weeks, the daughter con- 
tinued periodically to bring jewelry to the kitchen and to receive 
"treats" for doing 50. Not once did she flush jewelry down the toilet. 


Eventually, the girl stopped playing with mother's jewelry altogether. 


Stimulus Control and Partial Elimination 

Lori was an attractive, severely retarded little girl with a very 
angelic face.* She was small for her age, slightly chubby, and had 
short blond hair and irresistible appeal. Perhaps in part because of 
these characteristics, she had gradually been shaped to be extremely 
persistent in her approach to the staff, so much so that she became a 
chronic pest. The following sequence was typical. While Bonnie, the 
nurse in charge of the ward, sat working in her office, Lori peeked in 
and said, Hi." “Hi, Lori, I'm busy now but I'll talk to you later," 
said Bonnie. "You busy now?" said Lori. There was no response 
from Bonnie, who was trying to work and to ignore Lori's pestering 
“You work hard?" asked Lori. (No response from Bonnie.) “Hi,” Said 
Lori. (No response from Bonnie.) "You don't love me?" said Lori 
with a sad look. “Of course I love you, Lori," said Bonnie, unable to 


resist any longer. 


This type of interaction between Lori and the staff was very 


common. Although the staff attempted to ignore Lori's behavior, it 
was almost impossible to do so consistently unless one were ex- 
ceptionally cold-hearted toward cute little girls. Many undesirable be- 
haviors are developed simply because repetitions of the behavior will 
finally produce a consequence. Lori was so cute in her approach and 
so persistent in her pestering that she inevitably received inter- 
mittent reinforcement from the staff for her pestering behavior. 

Since total extinction would have been extremely difficult (for 
the reasons mentioned above), the staff designed a procedure for 
eliminating the behavior only partially —that is eliminating it only 
when it was most disruptive. Each staff member received a two-by- 
four-inch card to be pinned to his shirt or dress. The card was red On 
one side and green on the other. In general, during certain intervals 


ased on an unpublished case report at Cedar Cottage 


ing example is b 
a Prairie, Manitoba, 1971 


*The follow 
ba School, Portage i 


The Manito 


254 

Some 
Preliminary 
Considerations 
to Effective 
Programming 
Strategies 


throughout the day, all of the staff would turn their cards to the 
green side and Lori’s pestering would be reinforced. At other times 
of the day, the staff would turn their cards to the red side and no 
pestering would be reinforced. On the first morning of the proce- 
dure, a staff member walked towards Lori very quickly, before she 
had a chance to begin pestering, and said very quickly, and firmly, 
“Hi, Lori. See my card (while pointing to the card)? I can’t talk to 
you because the card is red. I'll see you later." The staff member then 
quickly turned and walked away, leaving Lori standing there in a 
state of stunned silence. Within just a few seconds, the Staff member 
returned with the green side of the card showing. Smiling pleasantly, 
she said, "Hi, Lori. See my card? It's on the green side 
talk to you." The staff member the 


e, if Lori attempted to approach 
, that person immediately pointed to his card and in- 


reinforcer. 


There are many other exa 
that are disruptive for teachers, 


GUIDELINES FOR DECREASING BEHAVIOR 


Throughout this text, a number of different 

xt, procedures f i 
undesirable behaviors have been described. Prior to im sd 
particular procedure for a particular undesirable behavior ia aaa 


consider two questions: 


1. How can the problem be formulated in terms of increasing a desirable b 
e De- 


havior? 
2. What are the likely causes of the undesirable behavior? 


on the answers to these questions, one might next (if ap- 
propriate) consider the procedures listed below. In general, for o " 
mum results they should be considered in the order listed. _ E 


1. Shortcut tactics 
a) Instruction 
b) Situational inducement 
(1) Relocate people. 
(2) Change time of activity. 
(3) Move activity to new location. 
(4) Rearrange surroundings. 
c) Instruction, modeling, and role playing 
d) Instruction and physical guidance? 
2. Indirect tactics 
a) Eliminate early component of a chain. 
b) Establish new stimulus control and use partial elimination 


3. Reinforcement schedules combined with extinction 
a) Extinguish undesirable behavior while rei i i 
l ONE behavior (Chapter 3) ee Smee al 
b) DRO (Chapter 6) 
c) DRL (Chapter 6) 
4. Punishment 
a) Time-out (Chapter 12) 
b) Aversive stimulation (Chapter 12) 


Depending 


Study Questions 
(for examination purposes) 
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1. What should be a behavior modifier's first question after being given a 
thorough description of an undesirable behavior to be decreased? Explain 
with an example. 

2. Discuss why extinction and punishment should not be among the first 
procedures to be considered for reducing an undesirable behavior. 
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3. State three broad reasons why it is important to consider the causes of 
undesirable behavior. 


4. Give two examples (at least one of which is not from the text) of the use 
of situational inducement to reduce an undesirable behavior. 


5. Give an example of the use of instruction, modeling, and role playing to 
reduce an undesirable behavior. 


6. Give an example of reducing an undesirable behavior by elminating an 


early component of a chain. Draw a diagram like those in Chapter 10 to illus- 
trate your example. 


7. Give an example of the use of stimulus control to partially eliminate an 


undesirable behavior. Draw a diagram like those in Chapter 7 to illustrate 
your example. 


8. Before deciding on a particular procedure for decreasing an undesirable 
behavior, what two things should you consider? 


Study Exercises 
(to be practiced by the reader) 


1. Identify two undesirable behaviors of som 


a) situational inducement 

b) instruction, modeling, and role playing 

€) eliminating an early component of a chain 
d) stimulus control and partial elimination 


Self-Modification Exercises 
(to be practiced by the reader) 


He r, | of a medical cause need not 
havioral treatment I PUR Re 
ines Mn oe ae be ineffective Nor, for that matter, does the exis- 
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p. 1034). That the same problem ma be effectiv 5 
haviorally or physiologically, NEA of its Mp Uer 
study by Ayllon, Layman, and Kandel (1975). These in REIR 
showed that hyperactivity in three children was decreased PAE COS 
cent by either the drug methylphenidate or by a behavior E CE 
procedure in which academic performance was reinforced Bit indo 
havior modification procedure also resulted in large increases eae 
demic performance, whereas the drug did not. It seems, theref: A 
in this case the use of behavior modification was definitel te ees 
ferred over the use of drugs. The two modes of treatment ste Sees 
ever, necessarily incompatible. There might be cases in tay ye 
and behavior modification combined would be more effective th oe 
ther alone. One study, however, did not show this to be true f n Rm 
activity: Christensen (1975) found that the drug EVRENE Ae 
produce any significant improvement in the classroom bahavt ps 
hyperactive retarded children who were also being treated with ded 


ior modification procedures. 

ple, there is evidence that seizures ME 7 
way. Seizures are sometimes preceded by pac mue n this 
iors. Zlutnick, Mayville, and Moffat (1975) found that they could ehav- 
prevent the onset of a child's seizure by shouting "No!" and sh phan 
the child vigorously immediately upon the occurrence of a rue ite 
behavior (which in one case consisted of a fixed gaze at a flat Ru 
such as a table top or a wall). In some cases, the preseizure beh ace, 
also decreased, suggesting that the procedure may have been rrt 


ing. 

One procedure that usually involves instruction ; N 
called overcorrection. Originally developed by Azrin AES E 
a component of their program for toilet-training adult retarded i oy as 
overcorrection is a procedure to "(1) overcorrect the NE livid- 
f an inappropriate act, and (2) to require the AUEN 
ctice overly-correct forms of relevant behavior” tose 
1 p. 2). The first part of the procedure is restituti OXX 
overcorrection, which requires the person who emitted an und tional 
behavior “to correct the consequences of his misbehavior b. pus 
him restore the situation to a state vastly improved from that eying 
existed before the disruption” (Foxx and Azrin, 1973, p. 2) as ich 
ample, someone who throws a piece of paper on the floor might be Te: 
quired not only to pick up that piece of paper and put it in the garbage 
can, but also any other pieces of paper that are on the floor pla 
The second part of the procedure is positive-practice overcorrecti y. 
which requires the individual to practice correct behaviors (as a ERU 
native to misbehavior). For example, the individual who threw NS alter- 
on the floor might be required to practice putting bits of paper Pr 
garbage can. Overcorrection procedures have been used MU rM 
to decrease such behaviors as aggression (Foxx and Azrin, 1972) c y 
ing (Azrin and Wesolowski, 1974), self-injury (Harris SAACHORE steal- 
1976), classroom disturbances (Azrin and Powers, 1975) AAM SI 
(Azrin, Sneed, and Foxx, 1974), ingesting fecal and other fictiniutrtülve 
material (Foxx and Martin, 1975), truancy from special self-care is ive 
(Foxx. 1976), self-stimulatory behavior (Foxx and Azrin, 1973), and det 
eotyped behaviors (Rollings, Baumeister, and Baumeister, 1977) SEN 

Positive-practice overcorrection may be used wi SAM 
overcorrection or by itself (with EE d that do A uad 


For exam 


uals, 
mental effects 0 


intensively to pra 
and Azrin, 1973, 


(Continued) 


) 


[s 
9 


ntaining it). 
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CHAPTER 17 


More About 
the Gradual Change 


Procedures: 
FADING, SHAPING 


and CHAINING 


ior modifiers frequently have difficulty distinguishing 
among cases requiring shaping, fading, and chaining. In many situ- 
ations, all three of these gradual-change procedures might be used. In 
other situations, one of these three techniques might be used primar- 
ily by itself. Although there is frequently insufficient evidence to de- 
cide conclusively that one of the procedures rather than another 
should be used, there are a number of guidelines that should be con- 
ed in making such decisions. However, in order to follow these 
guidelines, it is. necessary to use the terms shaping, fading, and 
chaining precisely, and in keeping with their usage derived from ba- 
sic research. Before describing the guidelines for selecting the appro- 
priate gradual-change procedure, we will briefly describe some of the 
confusion between the terms shaping and chaining. 


Novice behav 


sider 


SOME MISUSES OF THE TERMS SHAPING AND CHAINING 


e differential reinforcement of successive approxima- 
In original basic research, descrip- 
involved such things as the 


Shaping is th 
tions to a final desired behavior. 
tions of procedures labeled “shaping” 


259 


260 

Some 
Preliminary 
Considerations 
to Effective 
Programming 
Strategies 


differential reinforcement of successive approximations to the bar- 
pressing behavior of a rat and the key-pecking behavior of a pigeon. 
Early applications of shaping in applied settings included the rein- 
forcement of successive approximations to speech in a mute psy- 
chotic (through steps such as subtle eye movements, head move- 
ments, mouth movements, sounds, and finally specific words); 
overcoming withdrawal behavior in a child by reinforcing successive 
approaches to other children; and improving attention span in a se- 
verely retarded child by reinforcing approximations to a final desired 
duration of eye contact. In other words, as a technique, shaping is 
characterized by a clearly specifiable situation or set of circumstances 
in which the specific steps from a beginning response to a target re- 
sponse can be identified, measured, and differentially reinforced. In 
the above examples, it is very easy to describe the details of the 
procedure and to identify it as shaping. 

However, increasing applications of the procedure have been 
accompanied by increasing instances of vagueness in the use of the 
term. It is not uncommon to hear stu 


when talking about behavioral progr 
teacher really shapes good reading sk 
recognized authorities have written s 


is used to develop new behaviors that have never been performed by 
the individual, such as reading, feeding, and dressing." However, a 


careful analysis would reveal that the experiences that lead to read- 
ing, feeding, and dressing in n 


cation of differential reinforce 
as described in the above | 


dents of behavioral psychology, 
ams, say something like; “That 
ills in his students." Even some 
tatements such as this: "Shaping 


of the term may lead to casual at- 
eral shaping program to the devel- 
í rograms usually fail, and frequently 
asi statements of this sort: ^ tried behavior shaping and it didn’t 
work. 


The term chaining also suffers from increasing instances of 
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vagueness in its use. In basic resear D " 
originally meant a fixed sequence of pus dos amu Ss chan, 
stimuli (SPs) signaling each response in the sequenc ptus Ecce 
fers to a procedure used to develop such a Me Mu f Some did 
which a specific stimulus signals the end of each ne responses, in 
start of the next. Some applications of backward ots and the 
teaching bedmaking, shoe lacing, and specific dressin €: as in 
skills, are consistent with this precise usage. The a ien eats 
used, in our judgment, when people speak about a ene ogy is mis- 
behavioral sequences as behavioral chains. We are Are of general 
sequences as mastering a musical instrument, getting in zs to such 
athletic competition, studying two or three years for an ad ee 
gree, and writing a book. It is true that each of these dr er ee 
volves some kind of sequencing, in the sense that different aed 
leading to some goal follow each other in some order. Haws apes 
behavioral sequence in no way approximates the specifici ver, the 
behavioral chain involved in making a bed, or the zem vs 
when a rat presses a lever, pulls a string, and then turns a poesi 
of its responses occurring in a particular order to a particular S gach 
lus and being followed by food at the end of the sequence s aa 
much more than “chaining” involved in the above elida E 
of chains. In the writing of a book, for example, subtle sha ae 
een two co-authors as they gradually refine the e 
agraph by going over it several times in an hour. In ad 
s occur when they are asleep, taking holidays d "wi 
a few beers, and so on. In our opinion, it is of no abe , having 
such a complex set of activities as a chain of responses. Mis. € 
feel that referring to such a combination of activities in cy habs 
misleading, in that it implies a behavioral analysis that son e: 


not occurred. Also, as with the misuse of the ter 
um ^ m shapi 
aining are likely to add to the aeo aed mds 


behavior modifier may feel when trying to de- 
haining, shaping, or some combination of 
te for developing a target behavior in a 


occur betw 
a specific par 
dition, pause 


vague uses of ch 
fusion that a novice 
cide whether backward c 
the two might be appropria 
client. 

As Baer, Risley, and Wolf (1968) emphasized, we will make th 
most progress in communicating our behavioral techniques to othe e 
when we use precise and consistent language to describe eds 
dures. Behavior modifiers should refer to terminal enata: 
s” as behavior that is gradually developed ace 
than behavior that is gradually shaped, and to “writing a pook” as p; 
behavioral sequence rather than a behavioral chain. The followin 
discussion of the guidelines for choosing among shaping, va a 


and fading assumes a precise use of these terms. 


proce 
such as “hockey skill 


WHEN IS FADING, 


SHAPING, 


OR CHAINING MOST APPROPRIATE? 
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As you know, fading is a technique of 


gradually changing the stimuli 
controlling a response, until that res 


in which the desirable 
nder different stimulus control, and 
d. For example, one might be con- 
rn to be on time, to be courteous, to 
ing hostile Comments, to overcome 
ituations, and so forth. The last two 
problems can be managed by increasing desirable alternative behav- 
iors. Thus, our first guidelines should be these: 


1. When faced with a behavioral handicap, identif 
specific, positive behaviors to be increased. 


2. Search the client’s Current repertoire thoroughly to try to identify existing 
control of these behaviors, 


3. If existing control can be determined, consider the potential for a fading 
program. 


y the target in terms of 


at a hockey game?) Are th 
behavior is likely to occur? 
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law? priest?) Do other individuals emit the desired behavior in re- 
sponse to the desired stimuli, such that the client could have an op- 
portunity to model these individuals in the presence of those stimuli? 
Are there any room settings that are likely to evoke the desired be- 
havior? (bedrooms? bathrooms? auditoriums? bars?) It is important to 
remember that fading can be programmed to occur along almost any 
dimension. Fading might be managed along dimensions presented 
by means of audio or visual media (slides, tapes, movies, etc.). If, for 
example, a depressed person tends to feel relatively happy in the 
presence of certain people, it might be possible to transfer that con- 
trol to pictures of those people paired with the sound of their voice 
on a tape recorder. If so, it might then be possible to transfer that 
control through the use of appropriate fading procedures to almost 
any stimuli that can be presented by auditory or visual cues. To take 
another example, if a therapist can evoke some desirable behavior in 
a client during therapy, it might be possible to get that behavior un- 
der the control of specific cues that can be taken with the client 
wherever he goes (for instance, cue cards and auditory devices). 

In Chapter 15, we described a variety of ways of inducing be- 
havior by managing antecedent stimuli. In essence, what we are sug- 
gesting here is that these methods of capitalizing on an existing form 
of stimulus control, combined with subsequent fading programs, can 
be used to solve a great many problems and to develop a wide vari- 
ety of behaviors that will occur in response to appropriate cues. 

Let’s suppose a new behavior must be taught. If the behavior 
does not appear to occur in response to any stimulus in any situ- 
ation, a shortcut fading program is ruled out. This leaves either shap- 
ing or chaining. How does one decide whether to design a shaping or 
a chaining program? This question can be answered more easily if 


we first compare shaping and chaining along the dimensions shown 
in Table 17-1 (on the top of the next page). 
On the basis of the comparisons in Table 17-1, the decision to use 


shaping or backward chaining should be made after considering the 
nature of the behavior, the degree of structure in the training situation, 
and whether or not it is possible to train in a backwards” fashion. 
Examples of terminal behaviors that might best be developed through 
shaping are attention span, the force of a hockey shot, loudness of 
speech, accuracy of shooting foul shots in basketball, firmness of grip in 
a handshake, speed of answering questions, pronunciation of certain 
words, and the quality of a certain yoga exercise. Examples of terminal 
behaviors that might best be developed through chaining are making 
a bed, setting a table, hitting a golf ball, putting together a certain 
puzzle, putting ona bra, and tying shoelaces. 


Table 174. Some Differences Between Shaping and Chaining as They Are Typically Applied 


SHAPING 


a. To change behavior along 
Target some physical dimension, 

such as force, form (topogra- 
phy), duration, or latency. 

b. The terminal behavior is usu- 
ally simple. 

c. The successive approxima- 
tions do not necessarily form 
part of the terminal behavior. 


Training Procedure a. Often involves selectively 
reinforcing a student's behavior 
in an unstructured environ- 
ment in which the student has 
the opportunity to emit a 
variety of behaviors. 

b. Proceeds in a forward fashion 
in terms of the "natural order" 
of behavior. 


When Used in a. Often involves instructional 

Combination with control; may involve some 

Other Procedures Physical prompting at succes- 
sive steps, but usually mini- 
mally. May also involve some 
fading at successive steps, 
but this is unusual. 

b. Involves successive application 

of reinforcement and ex- 
tinction. 


Study Questions 


(for examination Purposes) 


1. Describe three exam 

would consider it ap 

2. Describe three exa 

would consider it i 

3. What are two Possi 

264 term "shaping"? 


ples of behavioral chan 
Propriate to use the term "shaping." 


CHAINING 


. To develop a sequence of 


responses, with a "clear-cut" 
Stimulus signaling the end of 
each response and the start 
of the next. 


. The terminal behavior is usu- 


ally more complex than in 
shaping. 


- All of the chaining steps are 


retained as part of the termi- 
nal behavior. 


. Typically involves linking 


together stimulus-response 
components in semistructured 
or structured teaching en- 
vironments, 


b. Often proceeds in a backward 


fashion in terms of "the 
natural order" of behavior. 


. Frequently involves verbal and 


physical prompts, physical 
guidance, fading, and perhaps 
shaping at successive steps. 


- Typically involves fewer ex- 


tinction trials than in shaping. 
because of the strong stimu- 
lus control established by 
prompting and fading at 
Successive steps. 
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4. What is the specific laboratory meaning of the term behavioral chain? 
5. Why is it inappropriate to refer to a behavioral sequ : 
d 2 sequence “petti 
in shape for an athletic competition” as a behavioral UA QS Ue tug 
6. If we do not refer to terminal repertoires such as “h : 
: k ock n 
behavior that is shaped, or to “writing a book” as a Wiig sche h 
should we describe such activities? rid 
7. When faced with the problem of developing a behavior, whi 
should be considered first: fading, shaping, or chee Wit ER 
8. When you want a client to develop a particular behavior i , kal 
uation, you should first try to determine if the behavior RE 
situations. You might then use a fading program to develop the termi vi 
behavior. List thirty possible dimensions along which fadin ei 
occur, and about which you might question the client. g might 
9. What are the major categories of "shortcut tactics" described in Chapter 
15? 
10. What are the differences between shaping and backward chaining as 
they are typically applied? 8 
11. List six terminal behaviors that might best be developed b 
shaping (three from this chapter and three from your own dic Sapo 5 
12. List six examples of terminal behaviors that might best be developed b: 
means of chaining (three from this chapter and three from your ed 


experience). 


Study Exercise 


(to be practiced by the reader) 


Suppose that you are a behavior therapist and a "typical" second-year uni- 
versity student comes to you for help. The problem is that the client "lacks 
self-confidence.” After some discussion, you identify expressing self-con- 


fidence as the target behavior to increase. 
(a) Identify five specific behaviors that might be considered indications 


of self-confidence. The development of these will be your target. 

(b) You are convinced that somewhere, in some situation, your client 
probably has shown self-confidence, as defined in (a). Consider six cate- 
gories to examine—namely, instructions, modeling, and the four categories 
of situational inducement. For each of these categories, prepare three ques- 
tions to ask your client in order to try to identify some stimuli that may con- 
trol his or her self-confidence. (Your subsequent programs will: then enable 
you to use those stimuli in a fading program to transfer the client's self-con- 


fidence to various university situations.) 


Self-Modification Exercise 


(to be practiced by the reader) 


n the study exercise above. If you so desire, sub- 


agine you are the client i ; 
stitute a | r the "lack of self-confidence” in the 


stitute a behavior deficit of your own fo: 
imaginary student mentioned above. 


Dealing 
With Data 


CHAPTER 18 — 
BEHAVIORAL ASSESSMENT: 


Initial Considerations 


Throughout this book, numerous examples illustrate the effectiveness 
behavior modification procedures. Many of these examples are ac- 
companied by graphs showing the changes (increases or decreases) 
that occurred in behavior when particular procedures were applied. 
Some of the graphs also include follow-up observations indicating 
that the improvements were maintained after the programs had ter- 
minated. The graphs were not presented just to make it easier for 
you to understand the material. Precise records of behavior are an in- 
separable part of behavior modification procedures. Indeed, some 
people have gone so far as to say that the major contribution of be- 
havior modification has been the insistence on accurately recording 
specific behaviors and making decisions on the basis of recorded 
data rather than merely on the basis of subjective impressions. Like 
Linus and his blanket in the popular Peanuts cartoons, the behavior 


modifier and the data sheet are inseparable. 


of 
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A successful behavior modification program typically involves at least 
three components during which behavior is recorded: (1) a basics 
or preprogram behavioral-assessment phase; (2) a treatment phase; 
and (3) a follow-up phase. During the baseline phase, the behavior 
modifier assesses the behavior in order to determine its level prior to 
the introduction of the program or treatment. Ideally, after making a 
precise baseline assessment a behavior modifier will design an effec- 
tive treatment program in order to bring about the desired behavior 
change. In educational settings, such a program is typically referred 
In community and clinical 
re often as an intervention 
Strategy or a therapy program. A distinguishing characteristic of 
s the insistence on contin- 
behavior of the students and 
ome cases, the difference be- 
approaches on this point is 
l educational practices typi- 
the teaching program for the 
f the students. Certain clini- 


measures and have lacked precise, 
ment. Nevertheless, the majority of 
have emphasized and practiced, to a 
approaches, continuous monitor 
cation of the specific treatment 

In addition to the require 
tervention strategy, behavior 


ongoing recording during treat- 
behavior modification strategies 
degree not often found in other 
ing of the behavior during the appli- 
strategies, ! 


ments of initial assessment and an in- 


ment program. These obse 
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Consider a behavior modification program set up for an enti 
room and conducted for many months. At the end of Be ire class- 
the children may go on to another class, graduate to an PoR 
gram, leave the school, or in some other way become dtu s 
follow-up observation. Under these circumstances, it aou | s s 
be impossible to do anything other than conduct a test that no 
sample a few of the behaviors developed by the behavior sem 
fication program. modi 
In early behavior modification studies, follow-up observati 
were not reported as frequently as most critics would have desired 
Whether or not behavior modifiers are now doing a better job of ed. 
viding such information, it is clear that follow-up observations nt 
the utmost importance in evaluating the ultimate value of eode 


modification programs. 


DATA! DATA! DATA! WHY BOTHER? 


There are a number of reasons for recording accurate data during the 
baseline and throughout a program. First, and most important, accu- 
rate baseline data provide a means for clearly determining whether the 
program has produced, or is producing, the desired change in behavior 
Sometimes people claim that they do not need to record data to know 
whether a desirable change in behavior has occurred. No doubt this 
is often true. A mother obviously needs no data sheet or graphs to 
tell her that her child is completely toilet-trained: there is ample evi- 
dence (or, hopefully, lack of it) in the child’s pants. 

But, not all cases are so clear-cut—at least not immediately. Sup- 
pose that a child is acquiring toileting behavior very slowly. The par- 
ent may think that the program is not working and abandon it pre- 
maturely. With accurate data, this type of mistake can be avoided. 
This point is nicely illustrated by the following case.* Dr. Lynn Cald- 

man whose six-year-old son was, in her 


well was consulted by a wo 
words, "driving me up a wall with his constant slamming of the 
kitchen door everytime he goes out of the kitchen." Dr. Caldwell re- 
quested the mother to obtain a baseline of the target behavior by tal- 
lying each instance of it on a sheet of paper attached to the refrig- 
erator. Over a three-day period, the total number of door slams was 
123. Dr: Caldwell then instructed the mother to provide approval 
each time the boy went through the door without slamming it. But 
she was to administer a brief time-out whenever he slammed the 
artment of Rehabilitation Medi- 


Lynn Caldwell, Dep: 
e First Manitoba Behav- 


in a taped presentation to thi 
la Prairie, Manitoba, 1971. 


*This case was described by Dr. 
cine, University of Washington, 
ior Change Conference, Portage 
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door (he was to go back and remain for three minutes in whichever 
room he had just left, and the mother was to ignore him during that 
time), and then require him to proceed through the door without 
slamming it. After applying this procedure for three days, the mother 
brought the tally sheet to Dr. Caldwell. “This behavior modification 
stuff doesn’t work,” she complained, pointing to the large number of 
tally marks on the data sheet. "He's just as bad as he ever was.” But 
when the tally marks were counted, there were only 87 of them over 
the three days of treatment, compared with the 123 that were entered 
over the three days of baseline. Encouraged by this observation, the 
mother continued the program, and the behavior quickly dropped to 


after which the satisfied 


e annoying habit of 
behavior modification 
an pinch. After the proce- 
achers agreed that they had 
tuting patting. When they 
€ observer, however, they 


; gh patting was considerably above the level it 
had been during the baseline recordings, pinching had not decreased 


from its baseline level. Perhaps concentrating on the procedure 
s that they failed to notice 


introducing the procedure. 
been for the recorded data, the teachers prob- 


the pinching as much as they had before 
In any case, had it not 


Someone thought to be a problem is actually not a problem. For ex- 
TR a teacher may say, “I don’t know what to do with Johnny; he’s 
a ways hitting the other kids." But after taking a baseline, the teacher 
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The reliance on casual observati 
plain to a psychologist that her E d gus 
during meal time. She said that his failure to "oen Rid vid 
coming an increasing source of annoyance to e. pecs 
wanted to do something about it. The psychologist voe 
that she prepare a chart and record on the chart the sa weer 
times that he initiated a conversation or responded fe eet i 
behavior that she emitted. She agreed to the sug vinis Ina 
end of a week, she called back to inform the m vnus € 
she was surprised and pleased to report that she had ie cp that 
ror. It turned out that her husband both initiated vend 
and responded to her verbal emissions at a very 2 Non ER 


A third reason for accurately recording and graphing behavior i 
ris 


that publicly posted results can be a powerful reinforcer for carrying out 
program (see Figure 18-1). Staff in institutions for the retarded de : 
, ex- 


often become more conscientious in applying proced 
ures 


ample, 

when up-to-date charts or graphs clearly showing the effects of th 

procedures are posted conspicuously on the wards. Parents and ma 
A ch- 


ers alike may find that their efforts to modify children’s behavior ar 
reinforced by graphic representation of the improved behavior D 


A fourth reason for recording and graphing behavior is that th 
a may lead to improvements apart from any further fend 
! Students who graph their own study behavior (for in- 
the daily number of paragraphs or pages stud- 
ied, or the amount of time spent studying) may find increases in the 
graph to be reinforcing. Data that are appropriately presented can b 
reinforcing even to young children. For example, an oe ona 
therapist at a school for handicapped children once consulted one of 
the authors concerning a seven-year-old girl who each morning took 
an excessive amount of time taking off her outside garments and 
hanging them up. It appeared that the teachers could not be per- 
suaded to stop attending to the child when she was in the cloakroom 
The author suggested that the therapist somehow attempt to Xeinisres 
the child with a graph of the amount of time she spent in the cloak- 
room each morning. The procedure that the therapist devised proved 
to be as effective as it was ingenious.* A large chart was hung on the 
wall. The chart was colored green so as to represent grass, and a car- 
rot patch was depicted near the bottom of it. Days were indicated 
along the bottom of the chart and the amount of time in the cloak- 
g the side. Each day, a circle was marked on 


room was indicated alon 
the chart to indicate the amount of time spent in the cloakroom in 


the morning, and a small paper rabbit was attached to the most re- 
cent circle. Using simple language, the therapist explained the proce- 
dure to the child and concluded by saying, "Now let's see if you can 


ancy Staisey for providing u 


displayed dat 
ment program.” 
stance, by recording 


is with the details of this procedure. 


*We are grateful to N. 
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get the bunny down to eat the carrots." 
s." When the i 

to the level of the carrots, the child was uud E down 

there: "Remember, the longer the bunny stays in the carrot ad him 

more he can eat." A follow-up showed that the knee ee the 

avior 


persisted over a period of one year. 
Behavior modifiers were not the first to discover the useful 
ness 


of recording one's behavior to hel i 
p modify that behavi i 
many other supposedly "new" psychological isses, = pis 
credit should perhaps go to the writers of great literature Fo soe 
ample, in his autobiography, first published in 1883 Anthony frol. 
; ol- 


lope stated: 


When I have commenced a new book, I hav 

diary, divided into weeks, and carried on DIDI E 
have allowed myself for the completion of the work ro 
have entered, day by day, the number of pages I have wri 
so that if at any time I have slipped into idleness for <_< 
two, the record of that idleness has been there ibas ld 
the face, and demanding of me increased labour so dar. he 
deficiency might be supplied. According to the ciscumistá ilie 
the time,— whether my other business might then be — 
light, or whether the book I was writing was or was not Wan a 
with speed,—I have allotted myself so many pages a week. - 
average number has been about 40. It has been placed as low " 
20, and has risen to 112. And as a page is an ambiguous t ei 
my page has been made to contain 250 words; and 2 tin. di 
not watched, will have a tendency to straggle, I have had hs 
word counted as I went. ... There has ever been the Sanat qoe d 
and a week passed with an insufficient number of 


fore me, 
pages has been a blister to my eye and a month so di 
would have been a sorrow to my heart. (Trollope, ace 


novelist who used self-recording 


Ernest Hemingway is another 
ut, One of his interviewers re- 


to help maintain his literary outp 
ported: 

f his daily progress— so as not to kid my- 
hart made out of the side of a cardboard pack- 
ing case and set up against the wall under the nose of a 
mounted gazelle head. The numbers on the chart showing the 
daily output of words differ from 450, 575, 462, 1250, back to 
512, the higher figures on days Hemingway puts in extra work 
so he won't feel guilty spending the following day fishing on 


the gulf stream. (Plimpton, 1965, p. 219) 


He keeps track o 
self —on a large ¢ 


The well-known contemporary author Irving Wallace used self- 
e he was aware that others had done the same. 


recording even befor 
his writing methods, he commented: 


In a book touching on 
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I kept a work chart when I wrote my first book — which remains 
unpublished —at the age of nineteen. I maintained work charts 
while writing my first four published books. These charts 
showed the date I started each chapter, the date I finished it, 
and number of pages written in that period. With my fifth 
book, I started keeping a more detailed chart which also showed 
how many pages I had written by th 
day. I am not sure why I started keeping such records. I suspect 
that it was because, as a free-lance writer, entirely on my own, 
without employer or deadline, I wanted to create disciplines for 
myself, ones that were guilt-making when ignored. A chart on 
the wall served as such a discipline, its figures scolding me or 
encouraging me. (Wallace, 1971, pp. 65-66) 


e end of every working 


SOURCES OF INFORMATION FOR BASELINE ASSESSMENT 


In the great majority of behavior 


modification Programs, both during 
initial assessment and during th 


€ intervention phase, sources of in- 
formation come from direct observation of the behavior to be modi- 
fied.” In most of the case histories described in this book, the behav- 
ior of concern was directly observed and measured. 


There are a number of advantages to direct observation. First, it 


tends to influence the observer to be precise in describing behavior. When 
an observer attempts to record s 


“aggression,” or ‘sympathy,’ or ''co- 
operation," she will experien 


Ponents will be c 
"sympathetic," or "cooperative." 


vation has helped to make the behavior modifier highly accountable for his 
programs. When one takes accur. ] 
and during a program 
is failing and/or prod 
the behavior modifier t 


ately obvious if a program 
ucing undesirable side effects. This influences 
o do a good job. 


of problems, direct 
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havioral programming. Some examples of such inventories are the 
Behavioral Self-Rating Checklist (Upper, Cautela, and Brook, 1974); 
the Sundel-Lawrence Problem Behavior Checklist (Sundel, and awe 
rence, 1974); the Fear Survey Schedule (Wolpe, 1969, Appendix 3; 
Wolpe and Lang, 1964); a measure of test taking anxiety (Guinin, 
1969); and the Pre-Marital Counseling Inventory (Stuart and Stuart, 
1973). Additional examples and discussion of behavioral seessmant 
can be found in Hersen and Bellack (1976) and Mash and Terdal 
(1976). 

In some cases, information may be based on the subjective im- 
pressions and memories of others (parents, relatives, friends, employ- 
ers, peers, and so forth). One would hope that this information 
would simply be supplemental to the development of a program and 
not be the major basis for a treatment strategy and its evaluation. In- 
formation that is to be obtained from interviews with individuals 
other than the student or client can generally be improved if ques- 
tions are asked that relate to specific behaviors. For example, it’s one 
thing to ask, “What do you think of the student's socializing abil- 
ity?" It's quite another thing to ask, “Have you ever seen the student 
fight with anyone? Dance with anyone?" Some information may be 
of a medical or biological nature, indicating knowledge of the stu- 
dent's physical characteristics or medications that might be helpful 


in program design. 


SPECIFYING BEHAVIOR PRECISELY 


Before collecting baseline information on specific problems, it is usu- 
ally necessary to refine the definition of the behavior that will be ob- 
served. A standard rule is that a behavior should be defined precisely 
enough so that two observers can simultaneoulsy but independently 
record a behavior of an individual and obtain agreement on their to- 
tal count. The importance of this task can perhaps best be illustrated 
by some examples. The following hypothetical account is typical of 
many interactions the authors have had in teaching staff to precisely 
specify behavior for baselining purposes. 

ore lunch one day, Garry said to one of the attendants, 
ime we should do some work with the feeding 
the severely retarded girls. Why don't you 
ehavior, and then we'll record it. If our 
ly, that would indicate that your definition 
hat should we record?" Mary replied, 
a lot. Ill define slopping as the 
hey're eating. That should be easy to 


tes later, Garry and Mary were standing about 
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sheet. After recording slops for the duration of the meal (about 
twelve minutes of actual eating time), Garry and Mary compared 
their "slops." "Hey, what's this?" said Garry. "I've got forty- 
two slops and you only have twenty-one. How come I have 


that?" asked Garry. “It seemed that that was one steady slop so 
I just counted that as one,” replied Mary. “Oh, I counted that as 
a slop if it occurred once in every ten seconds, so that gave me 
about ten more slops than you right there." After some further 
discussion and prompts from Garry, Mary refined the definition 
so that it read as follows: "Slopping food: An instance of slop- 
Ping is to be recorded whenever food drops and lands any- 
where except in the person's mouth or back on the plate, as a 
result of (a) the student moving a utensil from her plate to her 
mouth, or vice versa; (b) the student loading her utensil with 
food or attempting to cut through it; (c) the student moving her 
plate or dish around; (d) the student dropping food from her 
mouth (i.e., slobbering). These occurrences are to be counted as 
one instance of slopping, regardless of the actual amount of food 
that may be dropped on any one trial or movement." 


We have also encountered 
testing whether or not a Particul 


Pair of slacks, placed them in fr 
please put on the slacks.” 


o is grab them at the BE 
them on.” This example illustrates a secon 
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amples could be cited. The point here is that behaviors initially d 
y de- 


Behavioral i 
scribed merely as "aggressive, 


“mu 


B pe i 
ooperative," "dressing," and so 


Assessment f 
orth, must be given more precise descripti 

d criptions for s 

recording purposes. observational and 


E € — H—À 


Study Questions 
(for examination purposes) 


. What are four re 
. What type of 


. What typ: 


. Briefly descri 


. When interviewing 


. What two standard rules 


What do some people consider to be a major contribution of behavi 
or 


modification (other than behavior principles and procedures)? 
. What are the minimal components of a behavior modification program? 
. What is the difference between a training pro; 
gram, a therapy program, 


and an intervention strategy? 
What is one thing that makes behavior modification programs different 


from many traditional educational and clinical programs? 


asons for collecting accurate data throughout a program? 


error is exemplified by the case of Dr. Caldwell and the 


door slammer's mother? Explain how accurately recorded data counter 


acted this error. 
e of error is exemplified by the case of the pinching patter? Ex- 


plain how accurately recorded data counteracted this error. 
be the details of the clever graphing syst i 
t the rabbit to the carrot patch. EUN erase ae HN 


child who go 
f direct observation of the behavior to be 


What are two advantages © 
modified? 
someone about the behavior of concern, hi 

s? Explain with reference to an example. owushould 
should be followed when describing behavi 
for observational purposes? Explain with reference to an uude RYE 
Describe how Trollope followed one of the two standard rules for defin- 


ing behavior. 


one ask the question. 
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(Continued) 

be affected; (d) effects may occur in the setting where the manipulation 
occurred, other settings, or both: (e) effects may occur immediately, 
somewhat later, or much later.” Thus, although it may seem to you that 
behavior modifiers are very "data-conscious," Willems suggests that we 
should be far more data-conscious than we have been in the past con- 
cerning the effects and side effects of behavioral procedures. 


For example, Pawlicki (1970) reviewed behavior-therapy research 
with children that was published between 1965 and 1969. Of fifty-four 
up. Some of these 


with parents, the reliability of which is obviously questionable. 


The two types of errors illustrated here are s 
have been given special names: “Type | errors" and "Type Il errors." A 
Type | error is that of concluding that a given procedure is effective 
rror is that of concluding that a given 
experience, we 


o common that they 


fering with this problem for thirty ye 
nine-year-old boy's repetitive hand 


lass, of a hyperactive eleven-year-old girl. 
In all three Cases, the behavior decreased over a Six-week period as a 


phing. When each of the clients 


Six to twelve months following the termi- 


! f 9 initial decreases in the unwanted behav- 
ior, but it seemed necessary to continue the counting in order to keep 
the behavior at a low level. 


In some cases, it might even b 


Uuggested that a person's "verbal descrip- 
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CHAPTER 19 
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What to Record and How 


Let's suppose you are convinced that 


you cannot be a behavior modi- 
fier unless you keep good records 


z x ing a 
time he goes to bed, ae. 
number of times he turns over i 


uses per day, the number of times he b 


urps, or his total sitting time 
If you did attemp 


8 two things would ipee 
impossible task, and Y 
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Frequency 


A measure that is often useful is th i 
NE 2 i e number of insta 
d oo MEER period of time. If you are peri 
ee ing E: a child, for example, you might examine i 
onte oes and the frequency of eating with hands duri : 
men: d Pia Ficus often used interchangeably with fre ing 
7 tep would be to attempt to define sl d 
eating with hands in such a way that you or anyon esce Box 
serve the child and decide when either of these is m m 
us suppose you define the responses in the ‘atone pp tae on 
1. Slopping food: An instance i i 
ever food drops and lands Ac Rac yaad a S 
e 


on the plate, as a result of: 
a) the child moving a utensil from her plate to her mouth, or vi 
; Or vice 


versa; 
b) the child loading her utensil with f 
ood i 
through it; Of ANS PUG: oreu 
c) the child moving her plate around; 
d) the child dropping food from her mouth. 
Each of these occurrences is to be count 
4 ed as one i 
slopping, regardless of the actual amount of ee ial 
dropped on any one occasion. SEADSy: be 
2. Eating with hands: An instance of eatin i 
i g with h i 
corded any time the student touches her food Wier bar ben et 
while in the process of placing food in her mouth. If the UN 
slops while using her hands, then we will record an eel 
slopping as well as an instance of eating with hands. iis 


w what behaviors to look for. Your next step is to 


take a baseline of how many slops and how many instances of eatin 
with hands occur during several meals. If you have a helper to Aa 
serve your student during the meal, he might use a data sheet such 


as that shown in Figure 19-1. 
ndividual simply doesn’t have a helper 


In many situations, an i 
e time to take nice neat data with paper and pencil. Fortunately, 


ways of measuring quantity that require minimal 
thod is to use a counter, such as the relatively in- 
wrist-watch type used by golfers to record 
you can count up to ninety-nine sim- 
h instance of the behavior.' Another 
such as a bead, from 


Now you kno 


or th 
there are other 


time. One such me 
about $5.00) 


With these counters 


button for eac 
ransfer an item, 


expensive ( 
their score. 
ply by pressing à 
easy recording technique is to t 
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Date: (amem | OBSERVER: ohn K _ 


STUDENT: fuz. 


Observation 
Instances Total Time Additional Comments 
v | Adonis at the abe, Hual: 
SLOPS AT 2 2022 
Hu doua, maihid getto, 
: LR pontes weg., jello; milk 
EATING WITH " 
HANDS 1/1 ti lOmin 


day, depending on the parti 
ber of beads in the second 


(in which she and her chair were pulled 
d there for ten seconds) following each 
is program of time-out, the slops per meal 
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Baseline TO for Slopping 


350 
300 F 
6 250r PEE cats 
* 
$ 
$ 200r 
a 
3 
oc 
e 150 
2 
E] 
2 
$ 100} 
o 
B 
50r 
A 
pepe pep pe pq p ppm 
ott tes 7 8 9 10 11 12 13 14 15 16 17 18 19 20 
il Meals 
A 
Baseline TO for Slopping 
30r 
D 
25} 
(o 
i 20} 
gs 
£ 
o 
a 
$ 
€ 10r 
5r 
Je p psp qq 4 4 
2 13 14 15 16 17 18 19 20 
67 8 910111 
Lin arose 2 Meals 
B 
f raph (B) of the same 
aph (A) and a frequency g 
.2. A cumulative gr 
FIGURE 19-2. 
aa ints of the graph describe the child's perfor- 


The first = Lent meal, when no attempt was made to in- 
e 


mance during t An inspection of the performance on the first ten 
fluence Slane sive record shows a medium slope (not too steep 
meals of the cu 
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and not too low) of the graph line. The slope of the line gives us an 
idea of how many responses occurred over a given period of time. In 
other words, it provides an indication of the rate of response. The 
rate of response is directly related to the slope of the graph line: a 
steep slope indicates a very high rate of response and a low slope in- 
dicates a low rate of response. In Figure 19-2A, the medium slope 
during our initial observations indicated a medium rate of respond- 
ing. One feature of the cumulative record should be noted: the line 
can never decrease. If the child is not performing at all, in which case 


there are no responses cumulating to what is already there, then the 
line would be flat. 


tive record by a very low slope. 


A second type of graph is shown in Figure 19-2B. We call it a 
frequency graph. The features of this 
consider how each of th i i 


during meal 1, a point is made corres 


line and meal 1 on the horizontal line (see point C). Since 27 slops 
occurred during the secon 


in office and place an X in the appropriate 
in Figure 19-3, 


Time Out for Biting 


Baseline 
: H 
17 
16 x 
15|X i-r 
14| X| X X xIx x 
z nR xix|x|x| |x|x rt 
= 2 |x| x |x] x |x| x] x |x| x] x 
$ n[x[x|x| x x|x| Xj xiX|x 
ee AE 
& 9|x|x|x|x|x ix x x x x | 
É sg[x|x|x|x|x|x| X|X|X|X 
?[xIxIx [xx | x] x [x] x] 
e[xX[x|xIx|x|X|X|X|X|X 3l 
s|x[xIxIxI|x| x| X|X|X|X ik 
Mer Ree LL x 
ax IxIxTxTxIEx [x] x [x] x] x +} 
ee [x [ + 
aranne e EE PPX x X 
C cractursrrtpti4 ILI ELE LE LLL 2828 


Days 


FIGURE 19-3. Jackie's biting behavior. Each X represents one bite. 


o decrease the biting attacks to zero. This type of 
graph is especially useful for those who do not have the time to re- 
chart their behavior tallies from their data sheet to a graph.* 

Each instance of a behavior that is recorded in terms of fre- 
quency, such as slopping or biting as defined above, is a separate, 
individually distinct behavior that is easy to tally in a given period of 
time. Behavior modifiers have recorded the frequency of such behav- 
iors as saying à particular word, swearing, throwing objects, com- 
pleting arithmetic problems, mouthfuls of food, puffs on a cigarette, 
and nervous twitches. Each of these behaviors has characteristics such 
that successive occurrences of the given behavior are relatively dis- 
crete and the amount of time that it takes to perform the behavior is 


atively similar from one occasion to the next.’ 


worked quite well t 


rel 


Quality 

eral evaluations of whether or not a person is good at 
t something relate to how many times they tend 
in a given period of time. For example, the 


Many gen 
something or poor a! 
to emit some behavior 


*Another description of this type of graph is provided by Deibert and Harmon (1970). 
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person who is a good student is most likely someone who shows a 
high frequency of studying and answering test questions correctly. 
An individual who is said to be a “cooperative child” is one who 
shows a high frequency of doing w 


quality of eating performance, we might arbitrarily decide that any 


assessment would be to specify 


identify different levels of the quality of that behavior, For example, 


consider the behavior of arm raising in terms of the steps shown in 
Table 19-1. 


TABLE 19-1. Levels of arm raising from poor quality to good quality. 
1. While sitting at a table and rest- 


the student raises an arm so that 
ing both arms on the table, 


the hand and forearm are two 
inches off the table. 
2. While sitting at a table and rest- 


the student raises an arm so that it 
ing both arms on the table, 


is approximately at the student's 


chin level, 
3. While sitting at a table and rest- the student raises an arm so that it 
ing both arms on the table, is approximately at the student's 
eye level. 


4. While sitting at a table and rest- 
ing both arms on the table, 


5. While sitting at a table and rest- the student raises an arm so that it 
ing both arms on the table, 


iS pointing upward with his hand 
Six inches above his head, but the 
elbow is still bent. 


the student raises an arm so that 
his hand is slightly above his head. 


6. While sitting at a table and rest- the student raises an arm so that it 
ing both arms on the table, 


is pointing straight above his head. 


would provide us with an in- 


of arm raising at any point in time on any 


In some cases, one might assess quality by utilizing in- 
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strumentation to make the a i 
k ppropriate judgm m 
part of a system or s the quality ot cene ie gon 
P im i 
able 19-2. The decibel level (the toin the 
e 


sponse is shown in 
a device called a voice meter. 


sound) is measured by 


TABLE 19-2. Levels of quality of the verbal response "M. a 


TEACHER 
STEPS BEHAVIOR’ STÜGENT BERAVIORS 
12 T says “M” S says “M” within 2 tries 
in SL HN. at 6 i 
H p i a > says "M" within 2 tries at 56 eee S dd 
à 2 pin soe x says “M” within 2 tries at 50 decibels i MES 
8 T aay aM” S Min M^ within 2 tries at 45 decibels or ME 
7 Tsays"M" S ae “M” within 2 tries at 40 decibels or m 
5 T sais "M" ES ys Mom within 2 tries at 35 decibels or Es 
B Ts M" S bns di within 2 tries at 30 decibels or p 
: Teu M" S ays oh within 2 tries at 25 decibels or WE 
: T "e ane RS says M within 2 tries at 20 decibels o i 
ys" M. says "M" within 2 tries at 15 decibel ME 
2 T says WU S says "M" within 2 tries at 10 decus AE 
1 T says “M S says “M” within 2 tries at 5 decibels e uu. 
ore 


) to say "M," the student initially responds with a vi 
ery 


T) asks the student (S) 
step 1, T shapes louder (better-quality) "M"s. (Tabl 
^ e 


*When the teacher ( 
eral trials. beginning at 


quiet "M." Over Sev 
from, Kaprowy. 1975) 


have also been prepared tha 

1 t enabl 
uality of certain behaviors. pe bern 
le (1974) which is designed for Mies 


Questionnaires 
to assess subjectively the q 
is the Adaptive Behavior Sca 
handicapped individuals. 


Timing 
major ways. The first aspect of con- 
ar behavior. For example, in dealin 
rums you may not be particularly concerned (at per 
eir frequency (how often they occur) or with "wn 
ht be quite concerned with s 
long they last. Other examples of situations in which duration of re- 
sponding is important are attention span, sitting in one's seat in a 
classroom, watching television, talking on the telephone, and taking 
coffee breaks. 
If you are concerned with changing the duration of a behavior 
s, then the type of data sheet shown in Figure 19-4 might 
te. However, if you are concerned simply with keeping 
ivity over successive sessions, 


otal duration of some acti 
might easily tabulate and present these data for ef 


Timing is of concern in two 


cern is the duration of the particul 


with temper tant 


initially) with th 
quality (their severity) but you mig 


in session 
be appropria 
track of the t 
or days, then you 
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Teacher: A Student: ages Date: dee S73 


Attention Session Minutes 
Span 0 1 2 3 4 5 
7 
1-2 secs. Ill / 
=i +— | E d 
3-4 secs. 2 UE | | 
1 
5-6 secs. Aye / 
B - 
7-8 secs. J X|zi2zl / / 
ba 
3-10iers; | | FIXE |X] |t 


Procedure: While sitting in front of the student (S) (who has his hands on the table), hold 
a reinforcer (e.g., i 


ning with 1-2 Seconds), then give S a reinforcer other than the one attended to. After three 


for one reinforced trial. Record the data in t 
minute session. 


FIGURE 19-4. A data sheet and p 


rocedure used to increase the attention 
span ofa severely retarded student. 


Stimulus Control 


Frequently, we wish to assess a behavior in terms of the condi- 
tions under which it might be observe 
haviors occur in some situations and 
Nicholson, and Tallman (1975) design 
MIMR Basic Behavior Test, which ass 
basic skills of the severely and profou 
dent is instructed to perform a p 


not in others. Martin, Murrell, 
ed a detailed system called the 


D 


articular behavior— for example, 
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“Please put on your socks." The student's behavior is then scored a 
follows: à 
The behavior was performed appropriately in all respects without further 


prompting or guidance PEANY kinds. ASAE ROSEA Score 4 
The behavior was performed appropriately only after one additional verbal 


prompt (for example a verbal hint) was provided by the tester. ......Score 3 
The behavior was performed appropriately only after one additional verbal 
prompt and one gestural prompt were provided by the tester. ... Pec 


The behavior was performed appropriately only after verbal prompts, ges- 
tural prompts, and minimal physical guidance were provided by the Sed 


oes anie sida EN PP Isa sso anode gan Ceu SLR NES sais SAAE 1 
More than minimal physical guidance was necessary for the behavior to be 
performed appropriately. ..... eee Score 0 


Martin et al. identified specific behaviors that appear to be taught in 
most self-care training programs with the severely and profoundly re- 
tarded. Those target behaviors were then specified in the behavior 
test, instructions were prepared for the tester, and definitions of the 
different types of prompts were standardized so that the behaviors 
could all be assessed on the basis of the rating system just described. 
This testing system for identifying the conditions under which the 
behavior will occur is very useful as a prerequisite to training pro- 
grams with severely deficient individuals, in that it identifies the spe- 
cific level of guidance and prompting at which training should be 


initiated. , BUE 
In many cases, behavior modification programs concerned with 

the development of preverbal and verbal skills are typically preceded 
nts of the stimulus control of the student's ver- 


by behavior assessme f 
bal behavior. Tests are available that determine the conditions under 
which the students will emit appropriate imitative behavior, echoic 


behavior, or object identification (for example, see Kaprowy, 1975). For 
that matter, any test in which a student is given instructions, some 
paper, and a pencil and asked to answer the questions is a test of the 
stimulus control of behavior—are the correct answers under the con- 
trol of the questions? - 

In many training programs, the critical measure of behavior is 
whether or not the student correctly identifies some pictorial or 
printed stimulus. During sessions in which children. are taught to 
identify pictures, the teacher might be concerned with the overall 
number of correct responses relative to errors, perhaps computed asa 
“percentage correct." Across a number of training sessions, the 

her is likely to be concerned also with the total number of new 
i h a program was reported 


i learned. An example of suc 
Di Martin (1975); it involved individual daily sessions in which re- 


ded children were taught to name à variety of pictures. The train- 
es ipea is standardized, and each new (unknown) picture was 
ing 
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CONTINUOUS RECORDING, 


presented to a student in a series of prompt and question trials. 
Question trials on the new picture were interspersed with trials that 
required the student to name a known object (such as part of the stu- 
dent’s anatomy or items of clothing). For example, a new picture, 
"horse," was taught in the following way:* 


1. The teacher pointed to the picture of the horse and said, "What's that? 
That's a horse. What's that?" (a prompt trial) 

2. Following a correct response to the prompt trial, the teacher pointed to the 
picture and asked, "What's that?" (a question trial) 

3. Following a correct response to a question trial, the student was given a 
prompt trial, followed by a question trial, on a known object, each trial 
being accompanied by the teacher's pointing to the object to be named. 

4. If there were no errors, the teacher then randomly presented six question 
trials on the new picture and the known object. 

5. If an error occurred on any trial, the teacher turned away from the student 


for a few seconds and then repeated the entire seri 


es of prompt and ques- 
tion trials. 


6. Following errorless performance on the series of tri 
peated the cycle with that picture and a second known object. 


7. Following errorless performance on the series of trials with the second 


known object, the teacher again repeated the cycle, this time with a third 
known object. 


als, the teacher re- 


When the new picture was correctl 
ternations with three known objects, 
reaching criterion within a session, 
with another new picture. An exampl 
ual sessions for such a program appea 


The results of such a procedure might be graphed in terms of 
the percentage-correct performance, the percentage-of-errors perfor- 


mance, and the words learned per training session, on either fre- 
quency or cumulative graphs, 


y identified, following the al- 
the new picture was scored as 
and trials were then initiated 
e of the data sheet for individ- 
rs in Figure 19-5, 


INTERVAL RECORDING, 


AND TIME-SAMPLING RECORDING 


"This example was taken from Martin (1975b), and is closely paraphrased by permis- 
sion of the publisher i 
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DATE 


EXPERIMENTER 


SESSION 
NEW WORD: Elephant SUBJECT 
Column A Column B Cólumn € 
k1 eye k2 nose VT 
LISTED Pn a 2 
= = on Qn 
g' RK Pk "m 
4 Qk Qk ae 
5 Qn 11 Qn 17 Qn 
6 Ok 12 Qk TW 
ab Qn 13 Qn 19 Ok 
8 Qk 14 Qn 20 Qn 
9 Qn 15 Qk 21 Qk 
[NES 16 Ok 22 On 


S TO REACH CRITERION WITHIN A SESSION N 
K1 
K2 
K3 


TOTAL ERROR 


FIGURE 19-5. A sample data sheet for teaching picture n Dk 
sents known object, “n” represents new (unknown) Fera eee Ie 
: s 


for prompt trial, and “Q” stands for question trial. 


An alternative strategy is interval recording. Here, a specifi 
block of time is selected (such as a thirty-minute observation videl) 
This time is then divided into equal intervals of relatively short duis 

Is of ten seconds). A specified behavior is 


tion (frequently, interva 
then recorded a maximum of once per interval throughout the obser- 
vation period, regardless of how many times the behavior might oc- 
cur during each interval and regardless of the duration of the behav- 
ior. An observer might use a tape recorder that plays a prerecorded 
beep (or some such signal) every ten seconds. Let us suppose that the 
behavior of concern is an appropriately defined social-interaction re- 
sponse. If the response occurs once during a ten-second interval, a 
tally is made on the data sheet (for a sample data sheet, see p. 296). If 
] responses or continuous social interaction occurs during the 
|, the observer still makes only one tally. As soon 
d, indicating the start of the next ten-second inter- 
n recorded either 1 or 0 depending on its oc- 
ded in this way is typically graphed in terms 
ation intervals in which it is observed. 


severa 
ten-second interva 
as the beep is hear 
val, the behavior is agai 
currence. Behavior recor 
of the percentage of observ 
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Another behavior-observation technique frequently used is time 


Dealing sampling. In time-sampling procedure, a behavior is scored as occur- 
WER Dale ring or not occurring during very brief observation intervals, each of 
which is separated from the others by some longer period of time. 
For example, a parent of a preschool child might be concerned about 
the frequency of the child’s sitting and rocking back and forth (a self- 
stimulation behavior). It might be nice to have records of this behav- 
ior whenever it occurs and for as long as it occurs throughout the 
child's waking hours, but in general this is not realistic. An alterna- 
tive is for the parent to seek out the child once every hour and make 
a note of whether or not the child shows any sitting and rocking be- 
havior during a fifteen-second observation interval: each observation 
interval is separated from the next by approximately one hour. This 
type of observational technique enables one observer to observe one 
or more behaviors of one or more students, even though the observer 
has many other commitments during the day. An example of a data 
sheet for time sampling appears in Figure 19-6, 
Frequently, interval recording is combined with time-sampling 
recording.® One reason for this is the Possibility of missing observa- 
DATE 
Behavior Location Comments 
Time Sitting Standing Rocking Kitchen Living Room Bedroom 
8:00 AM E 
9:00 
10:00 ik 
11:00 
12:00 PM gii = 
1:00 Im = 
J Y 
2:00 
3:00 i= 
S 
4:00 
5:00 
6:00 ile Jh 
7:00 I" 
8:00 
9:00 PM 


FIGURE 19-6. A time-sampling data sheet for recording behavior of a child 
who frequently sits and rocks. 
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ASSESSING THE ACCU 


tion: i i i ici i 
voe iji, oe ea toe een aa 
" server 1S attempting to re d 
the occurrence or nonoccurrence of a behavior during ten-s e 
tervals. The behavior might occur at the start of the next a wed 
interval, while the observer is recording the results of the ae 
interval, and the observer might therefore miss the Moreau ii 
behavior. Thus, it is common for an observer to watch the d nus 
nterval (say, ten seconds) and then to record the Den for 
erval (the next ten seconds) over a given peri ics 
time (for instance, half an hour). Another reason for (rd ie A 
two systems is that one observer may wish to record the bahay : 
several students. In such a case, the observer might watch one itn 
dent for ten seconds and then record a behavior as occurring or d 
occurring, watch another student for ten seconds and record a behav- 
ior as occurring or not occurring, and so forth, until all of the stu- 
dents have been observed once. All of the students would then b 
observed a second time, a third time, and so forth, throughout we 
observation period.’ Strictly speaking, such an observation system 
could also be described as time sampling with a very brief time be- 


tween observation intervals. 


a specified i 
during the next int 


RACY OF OBSERVATIONS 


Hawkins and Dotson (1975) identified three sources of error that can 
affect the accuracy of observations. First the response definition might 
be vague, subjective, oF incomplete, such that the observer has prob- 
lems in taking accurate observations. Second, the behavior, even if it 
is precisely defined, might be difficult for an observer to detect, be- 
cause of distractions in the observational situation, because of other 
obstructions to the observing process, or because the behavior is very 
subtle or very complex. Third, the observer might be poorly trained, 
unmotivated, Or generally incompetent. To this, we might add that 
the observer might also be biased, and might therefore record data 

consciously. We might also add 


inaccurately, either consciously or un l 
ble source of error: poorly designed data sheets and 


a fourth possi 

cumbersome recording procedures. Because any one of these sources 
of error, or a combination of them, might be present in any behavior 
fiers frequently conduct what are 


SERM : n di 
modification project, behavior mod 1 
referred to a$ interobserver-reliability (IOR) estimates. Two indepen- 


dent observers might record observations of the same behavior of the 
same student. They are careful not to influence or signal each other 
while they are recording, OF to peek at each other s observations. The 
question is, given their best efforts while using the available behav- 
ior definitions d recording procedures, and considering their own 
training, hoW € eir scores compare? There are several ways 
of comparing their but two are more common than the others. 


an 
lose will th 
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Let us return to our example of the observer who is recording 
the number of slops, as defined earlier in this chapter. On day 1 Out 
observer recorded 21 slops. Let us suppose that on day 2 we bring in 
a second observer, who stands on the other side of the table and 
watches our student. The second observer is familiar with the defini- 
tion of slopping and uses exactly the same data-recording sheet as 
our first observer. At the end of the meal, our first observer recorded 
27 slops. Let us suppose that our second observer scored 29 slops. 
This can be converted to an estimate of our IOR by dividing the 
smaller number by the larger number and multiplying by 100: IOR = 27 
divided by 29 times 100 equals 93% IOR. Now it is important to ask 
what this IOR score means, It mean. 
quite closely (almost 100% 
mean that they agreed on 
server counting 2 extra to 
that one observer recorde 
The second observer coul 


the following Page. 


As you can see, the first 


s Observer counted 18 instances of touch- 
ing, as did the second obse 


Sseiver 


Observation Intervals (10 seconds each) 
5 10 15 20 25 30 35 40 a arate 
vior 
«sons. O EOE TTL 
Vocalizing +4] $ 
|l i| || In ! | i i l I 
Sierra 
Observation Intervals (10 seconds each) 
5 10 15 20 25 30 35 40 ae art 
vior 
Torma |! i l i | i| |) i|] VM TTT 
Vocalizing E 
|| |i |n inu | il] i| i 1 I| 


ehavior (agreements divided by agreements plus 


either recorded a b 
e occurrence of a behavior), and multiplying by 


disagreements on th 
100: 


Ae 16 
(OR ra Om gs EO SUUS 


What is considered an acceptable IOR in behavior modificati 
studies? It has been suggested that, by convention IOR should be d 
d 100% (Kazdin, 1975). However, potential variation e 
] procedures renders the final IOR value potentially 
misleading when considered by itself.“ We would suggest that ote 
ers of behavior modification literature consider the response defini- 
tions, observer-training procedures, recording system, method of ad 
culating IOR, and the final IOR value as a total package whe 

judging the reliability of reported data. Defects in any of these Mes 


make the results suspect. 


tween 80 an 
computationa 


SELECTING AN ASSESSMENT SYSTEM: 
ECISIONS! DECISIONS! 


Let us suppose that you have selected a particular behavior for which 
you want to develop a treatment program. Now you must decide 
what to record and how to record it. Usually, there are several behav- 
joral measures that might be taken, and several assessment systems 

he suggestions in Table 19-3 in order 


used. We offer t 
ill be most appropriate, accurate, 


that might be 
to help you select the strategy that wt 
and convenient. 
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TABLE 19-3. Guidelines for selecting an assessment system 


BEHAVIORAL 
CHARACTERISTICS 


Frequency 


Stimulus Control 


Quantity (frequency 
or duration) 


Quantity (frequency 
or duration) 
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SOME 
CONSIDERATIONS 


1. Responses are 
relatively dis- 
crete. 

2. Successive 
responses are 
quite similar in 
duration. 

3. Total number of 
responses is of 
concern. 

4. An observer is 
available, 


Same as 1-4 above, 
plus: 

5. Main concern is 
percentage of 
appropriate 
responses. 


Same as 4 and 5 
above, plus: 

6. Instances of 
behavior can be 
of long duration, 

7. Successive 
responses can 
be of variable 
duration. 

8. Precise duration 
is not of major 
concern. 


Same as 5-8 
Plus: 

9. An observer is 
recording two or 
more behaviors 
of two or more 
students. 


above, 


RECOMMENDED 
ASSESSMENT SYSTEM 
continuous fre- 
quency 


Continuous fre- 


quency per Opportu- 
nity 


interval recording 


Combination of 
interval recording 
and time-sampling 
recording 


SOME SAMPLE 
BEHAVIORS 


cigarettes smoked 

Pinches 

objects thrown 

saying "ain't" 

reprimands 

math problems 
completed 

self-slaps 

teacher attention to 
child 

going to the bath- 

room 


Correct imitations 

pictures identified 

School attendance 

Spelling errors 

compliance to 
requests 

(All of the above may 
be converted to 
percentage of 
total opportu- 
nities.) 


smiling 

Sitting 

lying down 

talking 

Social behavior . 

withdrawn behavior 

TV watching 

Studying 

On-task behavior or 
off-task behavior 
(e.g., in a class 
room) 


(same as those 
listed for interval 
recording) 


TABLE 19-3. (Continued) 


BEHAVIORAL 
CHARACTERISTICS 


Quantity (frequency 
or duration) 


Timing 


Timing 
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SOME 
CONSIDERATIONS 


Same as 5-9 above, 

plus: 

10. The behavior 
has a high fre- 
quency or dura- 
tion throughout 
long periods 
(e.g., a morning 
or a day). 

11. The observer 
has many other 
things to do and 
can devote only 
brief periods of 
time, which are 
separated from 
one another by 
long intervals. 


12. Precise duration 
is of major con- 
cern. 

13. An observer is 
available. 


Same as 12 above, 
plus: 


14. Appropriate 
behavior occurs 


with some fre- 
quency. 

15. Main concern is 
that the behav- 
ior occur at the 
time specified 
for it. 


RECOMMENDED 
ASSESSMENT SYSTEM 


time-sampling 
recording 


continuous duration 
recording 


continuous latency 
recording 


SOME SAMPLE 
BEHAVIORS 

sitting 

talking 

walking 

playing 

working 

rocking 

being in a particular 
location 


sitting 

social interaction 
time to run errands 
tantrums 
practicing piano 
task completion 


(same as those 
listed for Stimulus 
Control) 


Study Questions 


(for examination Purposes) 
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1. 


2: 


16. 


17. 


18. 


19. 


20. 


D 
- In what two major ways is ti 


- What behavioral cha 


- Describe with an exam 


Describe three Ways of keeping track of the number of times a certain 
Tesponse occurs during a day. 


Prepare a cumulative 


graph of the following instances of self-slaps that 
were observed durin 


8 Successive sessions: 3, 7, 19, 0, 0, 0, 27, 12, 6. 


a) a steep slope 
b) a low slope 
C) a flat line 


raw and briefly describe a data sheet that would also serve as a graph. 


ming important? Give examples of each. 
ency of a response? Give an example. 


Tacteristic does the MIMR Basic Behavior Test 
assess? Explain your answer, 


- Show all your computations. 
what is an acceptable IOR in a research pro- 
gram? What does "by convention" mean anyhow? 


uous-frequency assessment 
Table 19-3.) 


Study Exercise 


(to be practiced by the reader) 


oral deficiency, excess, or inappropri 
fully modified (for example, Peter's dee e amie ge en ate 
described in one of the other chapters. For that behavior: pill swallowing). 
a) design a plausible data sheet; i 
b repare a summa of some i 
) E ed ry representative data (real or hypothe- 
c) graph your 
d) graph your 


Select a behavi 


data in a frequency graph; 
data in a cumulative graph. 


Self-Modification Exercise 
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(to be practiced by the reader) 


Select one of your behavioral excesses, deficiencies, or inappropriaten 
swer questions a-d in the study exercise above esses. 


For that behavior, an 


A similar type of dial wrist counter for recording two behaviors up t 
99 and 9 responses, respectively, or one behavior up to 999 Meses 
can be obtained for about $6.00 from: Behaviordelia/PO Box d 
J7/Kalamazoo, Michigan, 49005. This company also makes a bead wrist 
counter, consisting of a leather band with four rows of nine moveable 
beads, which sells for about $11.00. A much more inexpensive counter 
that has been use! effectively by behavior modifiers is the Knit Talley 
counter, used in knitting. It costs about forty cents and is highly reli- 
able, even after extensive use. For more information, see Sheehan and 


Casey (1974). 

time-outs presented immediately following slopping re- 
ctively decrease such responses was demonstrated in 
i McDonald, and Omichinski (1971). They described a 


a study by Martin iversi 
y by hich undergraduate university students studied several un- 
aviors of four severely retarded institutionalized 


i e mea " i 
dU T ion of à fifteen-second time-out for each instance 
Á lopping behavior in three of the four 


ing € 
a had a small put consistent effect on the fourth student. 


students, an Í 
also observed a desirable 

e or more other undesirable responses of two of the stu- 
ES orary increase in one other unde- 


t was a temp 
f the students, although the increase did not 


last long. 


Simple 
raphs in 
cumulative 9 


(Continued) 


are much more common than c i 

frequency graphs i ; non 1 umulative 

ated modification studies. In some situations, however, a 
à 

raph i$ more advantageous. For example, a cumulative 
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(Continued) 


graph can give one a direct impression of rate of response much more 
easily than a frequency graph because in a cumulative graph the rate 
can be inferred from the slope of the line, as we Pointed out in the text. 
A cumulative graph is also to be Preferred when an experimenter is 
comparing two or more behaviors or conditions concurrently. For ex- 
ample, one of the authors conducted an experiment in which severely 
retarded and autistic children were taught to identify pictures of anto- 
nyms (wet versus dry, big versus small, etc.; Martin, 1975b). The chil- 
dren received two training sessions per day, one training session utiliz- 
ing one set of antonyms and the other training session being used to 
teach a second set. The procedure in both cases was the same, except 


for one factor. With one set of antonyms, wrong responses were fol- 
lowed by a brief time-out (five to ten second 
ply turned her head from 


Percent Errors/Session 
500 lu 30 20 
10 
e 400[- 
g 
ul 
= 
$ 300 
o 
a 
E 
e 
3 200} 
E 
3 
[5] 
100 - 9——9 5-10 Sec. Time-out 
9— -* 15-20 Sec. Time-out 
0 1 uit atl al J4 
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FIGURE 19-7, Cumula 


, tive percentage of errors by Roger during a picture- 
naming task under t 


wo experimental conditions, 


rch with lower Organisms, response dem 
onse over time) is a highly popular an 
(Continued) 
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(Continued) 

valuable behavioral measure. For the most i i 
ciples described in Chapters 2-13 refer to EE Xu as 
a response. It has been argued several times that the TE ae Ts 
probably the best measure of behavior for behavior modifiers to cup 
ine in applied settings (see, for example, Bijou et al. 1969; Kazdin 19732). 
However, it has also been argued that rate may not be the best E OR 
in applied settings (Wolf, 1973). We would encourage serious student: 
of behavior modification to acquaint themselves with these PONE 


uration of a response can sometimes be managed auto- 
ely connects timers to critical features of the 
r r for about twenty dollars it would be possible 
to wire up a chair that would automatically record the amount of time a 
student sits in it, assuming that this might be a desirable behavior. For 
a more detailed discussion of such a device, see Wolff and Baugh 


(1974). 

Behavior modifiers have not been completely consistent in the way 
they have described time-sampling recording procedures. Schaefer and 
Martin (1969) described time sampling as a procedure carried out by 
making observations at specified intervals over a given period of time. 
In their program, which took place in a mental hospital, observations 
were made every half-hour during the day. Behaviors were scored as 
occurring or not occurring during the few seconds that the patients 
were observed. However, Sundel and Sundel (1975), while explaining 
time-sampling recording, described an example in which an individual 
might be observed at the end of every fifteen-second interval through- 

ute observation period that occurs twice per day. Thus, 
the time between observations was extremely brief (fifteen seconds), in 
contrast with w e the more usual half-hour or one-hour 
interval between 0 rry the inconsistencies even fur- 
ther, Kazdin (1975) does not distinguish between interval recording and 
time-sampling recording, suggesting 
times referred to as time-sampling. — 
Martindale, and Kulp (19758) distinguished between whole-interval time 
sampling (equivalent to what we described as interval recording, with 
the stipulation that the behavior must occur throughout an interval in 
order to be counted), partial-interval time sampling (equivalent to what 
we described ding), and momentary time sampling 
(equivalent to what we described as time at AMO UE that 
i cquire more prec! onsistent usage as 
such terms will gradually acq ae the e o x 


i vior modification develops during t 
the field of E is probably wise to carefully explain how you are using 


n describing your procedures to others. 
Martindale, and Kulp (1975) examined the extent to which 

ments compared with a continuous mea- 
of a secretary. As expected, the more 
es were made, the closer the agreement 
vials sample i s measures was. In addition, differ- 
d different types of errors. 


have suggested for computing IOR during in- 

umber of intervals on which ob- 
by the total number of intervals 
ents plus disagreements on 
archers, however, in- 


Timing the d 
matically if one appropriat 
environment. For example, 


frequentl 
between the S 
ent types of $a 


dure that we Nae 
The proce that of dividing the n 


terval recording Sy ed 

agree that à behavior l A 
Do roh alU recorded à pelear HO id 
a behavior), and multiplying py 100. 50 
(Continued) 


mpling rules produce 
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(Continued) 


rv- 
clude in their measure of agreements, agreements between two obse 
ers that no behavior occurred 


i i n 
tervals. However, when very few behaviors have been recorded, this ca 


detail in Bijou et al. (1969); Hawk 
and Bolstad (1 973). 


Study Questions on Notes 


Y explain how you are using the term 
"time-sampling recording”? 
5. What terms in this book are equivalent in meaning to, the terms “par 
tial-inverval time-sampling" and "momentary time-sampling," as use 
by Powell et al.? 
6. When is it especially misleading to include agreement on blank inter 
vals in computing IOR? 
7. For the data given on p. 2 
ments on blank intervals in yo 


CHAPTER 20 
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Doing RESEARCH 
In Behav r Modification 


In Chapter 18, as in many of the other chapters in this text, we em- 
phasize that a minimal behavior modification program should have 
at least three phases: a baseline phase, for determining the initial level 
of the behavior prior to the program; a treatment phase, in which the 

itiated; and a follow-up phase, for evaluating 


intervention strategy is in 
the persistence of the desirable behavior changes following termina- 


tion of the program. If a behavior modifier has done a good job of 
programming for generalization (described in Chapter 11), then the 
follow-up phase should show that the improved behavior is per- 
sisting. However, many publications concerning behavior modi- 
fication go far beyond these three minimal phases and describe data 
that demonstrate convincingly that it was indeed the treatment that 
caused a particular change in behavior. It is this emphasis on scientific 

tment was responsible for a spe- 


demonstration that a particular trea 
cific behavioral change that has produced a continual refinement of 


behavior modification procedures to their present highly effective 
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level. The value of such demonstrations might best be illustrated 
with a hypothetical example. 

Our example involves a second-grade student's frequency of 
successfully completing addition and subtraction problems in daily 
half-hour math classes. The student, Billie, was performing at a much 
lower level than any of the other students and was showing a great 
deal of disruptive behavior during the class. The teacher, Ms. John- 
son, reasoned that an increase in Billie’s performance of solving the 
assigned math problems might make it more pleasurable for Billie to 
work at the problems and might thereby decrease 
teractions with those around him. During a one- 
Johnson assigned a certain numb 
corded the number that Bill 


his disruptive in- 
week baseline, Ms. 
er of problems to the class and re- 
ie completed successfully during each 
half-hour period. Billie averaged successful completion of seven math 
problems per half-hour. Ms. Johnson next introduced a reinforcement 
program. She told Billie that for each math problem he completed 


minute of time to his physical 


THE REVERSAL-REPLICATION (ABAB) RESEARCH DESIGN 
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Let us suppose that Ms. Johnson, being scientifically incli ; 
aware of the above possibilities and would like to ies acies 
vincingly that it was indeed her program that was coo uei 
Billie's improvement. (Besides satisfying her curiosity = jen pes 
eral practical reasons why she might have wanted to es e di 
success of her program. For example, such a Filet mme ie me 
dicate whether she should try a similar procedure with an Lees in- 
lem Billie might have, whether she should recommend sinit a 
dures to Billie’s other teachers, and whether she should " ds 
procedures with other students in her class.) Therefore, at c bere 
the second week of the reinforcement program, she dliminated ih: £ 
inforcement and returned to the baseline condition. Let us su ana 
that the hypothetical results of this manipulation by the tea Pepe 
those shown in Figure 20-1. SES 
By the end of the second week of our return to the baseline co 
ditions (which is called a reversal), Billie was performing at a Ml 
approximately that of his original baseline. Ms. Johnson then rein- 
troduced the treatment phase, just as it had been before, and, as can 


- Baseline Treatment Reversal Treatment 
r | 
o 20F 
E 
$ 
5 
© 
a 
m 157 
£ 
E 
= 
s 10r 
o 
Ls e E L1 pe ee 1 p EPOD op E 
i Lie 10 15 20 25 cU 
Sessions C 
FIGURE 20-1. Hypothetical data showing a reversal-replication (ABAB) 


design for Billie. 
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be seen in Figure 20-1, Billie again improved his performance. Ms. 
Johnson had replicated both the original-baseline and the original- 
treatment effects. If some uncontrolled 
must hypothesize that it was m 
same time the treatment 
ring when the treatment 
less plausible with each 
have much more confide 
dure that produced the 
onstrated a cause-effect 
sometimes referred to as 
gram, sometimes referred 

The type of experim 
called a reversal-replicatio 


variable was operating, one 
ysteriously occurring at exactly the 
Program was operative, and was not occur- 
Program was removed. This becomes much 
successful replication of the effect. We now 


followed by a replication of the 
treatment phase (and, hopefully, of the effect). The baseline condition 
is often abbreviated “A,” and the treatment condition "B." Hence, 
this design is also called an ABAB design. 


The reversal-replication Strategy is the most common type of be- 
havior modification research design (Kazdin, 1975b). It has been used 


over such behaviors as slopping 
d Omichinski, 1971), recruitment 
Pierce and Risley, 1974), sentence 
vens-Long and Rasmussen, 1974), 


1 yon (Powers, Osborne, and Ander- 
son, 1973), composition writing rate (Van Houten, Morrison, Jarvis: 


and McDonald, 1974), and a great many others (see issues of the 
Journal of Applied Behavior Analysis), 


Although the reversal-re 
glance, beginning students 


However, other considerations may lead one to shorten O" 
lengthen a baseline in any applied research project. First, there are 
Scientific considerations related to the newness of the behavior an 
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Baselin i 
e Reinforcement Program 


E 


Frequency of Desirable Greeting Responses 
e. 
[^] 


iex 


Sessions 
hetical data for five children. 
les being studied. The area of behavior analy- 
sis reported most frequently in the Journal of Applied Behavior Analy- 
sis is that of classroom behavior (Kazdin, 1975b). Consequently, one 


might be more comfortable conducting a shorter baseline in a new 


study of classroom behavior than in a study of a completely unex- 
plored area, suc’ ing by car drivers. Second, prac- 


h as seat-belt wear! 
tical considerations might limit the length of baseline observations. 
The available time of the experimenter, the availability of observers, 
restrictions on students for completing projects on time, and any of a 
number of other factors might lead one to limit or extend the base- 
line for completely nonscientific reasons. 


Finally, ethical consid- 
erations often affect baseline 


FIGURE 20-2. Hypot 


the independent variab 


length. For example, if one is attempting 
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to manage the self-abusive behavior of a retarded child, then an ex 
tended baseline phase is ethically unacceptable. . odi- 
Another question that a beginning student in behavior m e 
fication research will encounter is this: How many reversals and A 
lications are necessary? Again, there is no easy answer to this he nt 
tion. If one observes a very large effect when the independe d 
variable is introduced, and if the area is one that has been e AP 
before, then one replication may be sufficient. Other e a ipia t 
factors might lead the student to conduct several replications in Or 
to convincingly demonstrate a cause-effect relationship. ber 
Although a reversal-replication design is the most common hat 
havior modification research strategy, it does have limitations oe 
make it inappropriate in certain situations. First, it may be aur 
able to reverse to baseline conditions following a treatment pare 
For example, in the case of Valerie's self-abusiveness (described on 
Chapter 3), it was ethically unacceptable to reverse to baseline imm. 
diately following the successful treatment. jé; 
Second, it may be impossible to obtain a reversal. For w^ 
"behavioral trapping" may prevent a reversal. In Chapter 11, (p. his 
we described how a shy child might be taught to interact with 


^ à inter 
peers; once the teacher's reinforcement Produces the desirable in 
action, the child's behavior m 


maintain it after the withdraw, 
haviors may not reverse 
has become “self-reinfor 


MULTIPLE-BASELINE DESIGNS 


As we noted above, a major purpose of behavior modification pa 
Search is to demonstrate the control imposed on behavior by à e 
ticular treatment, Multiple-baseline designs are used to accomP 
this without reversing to baseline conditions. 


A multiple baseline across behaviors 
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the improvement shown by Billie. She might have accomplished her 
demonstration of treatment control over improved performance by 
constructing a multiple baseline across behaviors. Her first step 
would have been to baseline two or more behaviors concurrently. 
Specifically, she might have recorded Billie’s performance in solving 
math problems during math class, his performance in spelling cor- 
rectly during English class, and his sentence writing during creative- 
writing class. These baselines might have been those shown in Fig- 
ure 20-3. The multiple-baseline design across behaviors calls for the 
introduction of the treatment sequentially across two or more behav- 
iors. The extra minute of physical education class per correct problem 
might have been introduced in the math class while the baseline con- 
dition was continued during spelling and writing classes. If the re- 
sults were those shown in Figure 20-3, the teacher might next have 
introduced the treatment for the second behavior—correct spelling. 
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al data illustrating a multiple-baseline-across- 


FIGURE 20-3. Hypother 
behaviors design for 
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Finally, the teacher might have introduced the treatment for the third 
behavior— sentence writing. If performance was as indicated in Fig- 
ure 20-3, then it clearly indicated that the behavior changed only 
when the treatment was introduced. This provides a very 
onstration of the control of the treatment over several behaviors. 

The application of this design assumes that the behaviors are 
relatively independent. If Ms. Johnson had applied the treatment pro- 
gram to one behavior while the other two behaviors were kept at 
baseline conditions, and if an improvement had been observed in all 
three behaviors, then she could not have confidently attributed the 
improvement to the treatment itself. An example of such general- 
ization across behaviors was reported by Nordquist (1971). 


clear dem- 


A multiple baseline across situations 


Another variety of multi 
of a treatment on a single be 
For example, Corte, Wolf, a 
eliminating the self- 


ple-baseline design studies the effects 
havior that occurs in sever, 
nd Locke (1971) 
abusive, face-hitting res 
in an institution, A 


al situations. 
were concerned with 


am utilizing brief 
-abusive behavior. Be- 


design 
eline acro 


settings. When this hap- 
that the improvement 
eatment. 
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A multiple baseline across people 


Yet another multiple-baseline design demonstrates the effec- 
tiveness of a treatment by-applying it sequentially to individuals. For 
example, Fawcett and Miller (1975) utilized a multiple-baseline- 
across-people method to demonstrate the effectiveness of a combina- 
tion of procedures (called a treatment package) designed to improve 
public-speaking behaviors. Public-speaking skills of three individuals 
were recorded during initial public-speaking sessions. The first indi- 
vidual was then given the package while the others continued on 
baseline. Exposure to the treatment improved the public-speaking 
behaviors of the first individual. The package was introduced se- 
quentially to the second person, and then to the third person, and 
each time it led to an improvement in public speaking behaviors. 
This demonstration of improvement in individuals who receive treat- 
ment sequentially across time is also a convincing demonstration of 
the effectiveness of a treatment program. A potential problem with 
this design is that the individuals involved might deliberately com- 
municate with or otherwise influence other individuals who are 
being baselined, and thereby cause these other individuals to show à 
change in behavior prior to the introduction of the treatment pro- 
gram (for example, see Kazdin, 1973). 

The obvious advantage of these three multiple-baseline designs 
over a reversal-replication design is that they eliminate the need for 
reversing to baseline conditions. On the other hand, it is not always 
possible to find two or more behaviors, two or more settings, or two 
or more individuals that can be multiple-baselined such that there is 
complete independence between the multiple measures. Moreover, it 


often takes additional time and/or observers to gather the necessary 


data for multiple baselines.’ 


DATA ANALYSIS AND INTERPRETATION 


Researchers who employ the behavior modification research designs 
described above typically analyze their data without the use of statis- 
tical techniques that are more common in other areas of psychology." 
The evaluation of the effect of a particular treatment is typically made 
on the basis of two major sets of criteria, scientific and practical. Sci- 
entific criteria are used to evaluate whether or not there has been à 
convincing demonstration that the treatment was responsible for pro- 
ducing a reliable effect on the dependent variable. This judgment is 
commonly made by visually inspecting the graph of the results. Prob- 


lems in deciding whether or not a treatment produced a reliable ef- 


fect on a dependent variable might best be appreciated by examining 


314 Figure 20-4. Most observers of the five graphs contained therein 

Dealing would probably agree that there is a clear, large effect in graph 1, a 

With Data reliable though small effect in graph 2, and questionable effects in 
the remaining graphs. 

Although there appear to be no consistently applied guidelines 
for inspecting one's data in order to judge whether or not a signifi- 
cant effect has occurred, there are a number of scientific consid- 
erations that should be kept in mind. One has greater confidence that 
an effect has been observed, the greater number of times that it is 
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replicated; the fewer the overlapping points between baseline and 
treatment phases; the sooner the effect is observed following the in- 
troduction of the treatment; the larger the effect in comparison to 
baseline; the more precisely the treatment procedures and response 
measures are specified; and the more consistent the findings with 
existing data and accepted behavioral theory.'? 

The practical considerations for evaluating the effects of a treat- 
ment are based on the importance of the behavior change to the 
client or other significant individuals in the client's life rather than 
the experimental reliability of the treatment's effect on behavior. That 
is, if graph 2 in Figure 20-4 were a graph of self-abusive behavior, 
the reliable cause-effect relationship demonstrated therein might be 
of little clinical significance. If the individual is still extremely self- 
abusive, as indicated by the performance during treatment phases, 
then the people responsible for caring for that child would not be 
satisfied. These practical considerations make the behavior modifier 
accountable to the client whom he or she is treating." 


Study Questions 
(for examination purposes) 


1. Briefly, what are the minimal components of a behavior modification 
program? 

2. In two or three sentences, distinguish between a minimal behavior mod- 
ification program and behavior modification research. 

3. In two or three sentences, explain why we cannot necessarily claim that a 
change in behavior during a minimal behavior modification program 
was due to the treatment. 

4. Briefly describe, with reference to an example, the four components of 
the reversal-replication design. 

5. Ideally, how long should the baseline phase of the reversal research de- 
sign continue? ] 

6. In a sentence or two each, describe why baselines 1, 2, and 3 from Figure 


20-2 are inadequate. l 
7. What scientific, practical, and ethical considerations might lead one to 


lengthen or shorten a baseline? l E 
8. How many reversals and replications are necessary in a reversal-replication 
design? 
9, Identify two limit 
brief example of ea 


ations of the reversal-replication design, and give à 


ch. 
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10. Briefly describe, with reference to an example, a multiple-baseline- 
across-behaviors design. 

11. When is a multiple-baseline-across-behaviors design inappropriate? 

12. Briefly describe, with reference to an example, a multiple-baseline- 
across-situations design. 

13. When is a multiple-baseline-across-situations design inappropriate? 


14. Briefly describe, with reference to an example 


, a multiple-baseline- 
across-people design. 


15. When isa multiple-baseline-across-people design inappropriate? 


16. In a sentence or two each, what are the scientific and practical criteria for 
evaluating the effects of a particular treatment? 

17. For each of graphs 3, 4, and 5 in Fi 
the treatment are questionable. 


18. Let us suppose that you have conducted 


gure 20-4, describe why the effects of 


19. How nors one go about evaluating the clinical effectiveness of a treat- 
ment? 


Study Exercise 


(to be practiced by the reader) 


> acung some students about doi i- 
lizes reversal and multiple-baseline designs. Your "EE RR ei ps 
ect a een variable and then evaluate 

pon that dependent variable, Your task as 
s chapter in order 


then choose a reversal desi n; but if 
baseline design; and so forth. THESE irana "t 


Self-Modification Exercise 


(to be practiced by the reader) 
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Actually, there are a number of reasons for conducting behavior 
modification research. Most often, the research is probably conducted 
to demonstrate that a particular treatment was responsible for a spe- 
cific behavioral change. In addition, however, research might be con- 
ducted to determine which components of the treatment may have been 
responsible for the behavioral change observed; to assess the relative 
benefits derived from a particular treatment in relationship to the costs 
(this type of research is called cost-benefit research); to help students 
complete Master's theses and Ph.D. dissertations in order to obtain ad- 
vanced degrees; to enable researchers to obtain research grants; to en- 
able one to publish, so as not to perish in one's professorial profes- 
sion; and for a host of other reasons. 


Potential interfering variables that might be mistaken for treatment 
effects are often discussed as factors that threaten "internal validity." 
An experiment is internally valid if the independent variable did in fact 
cause observed changes in the dependent variable. Campbell and Stan- 
ley (1963) listed several classes of variables that threaten internal valid- 


ity. Slightly paraphrased, these are: 


1. History: the specific events (such as a new student moving beside Billie, as 
described on p. 306) occurring between the baseline and treatment measures 
in addition to the treatment variable. 

2. Maturation: processes within the student (such as Billie overcoming his cold, 
as described on p. 308) operating as a function of the passage of time, such 
as growing older, growing hungrier, or growing more tired. 

8. Testing: the effects of being assessed upon one's performance in subsequent 
assessments (for example, Billie saying to himself, “Gee, Ms. Johnson is start- 
ing to keep my scores every math class. | guess | better shape up."). 

4. Instrumentation: changes in the calibration of a measuring instrument or in 
the observer's criteria (for example, Ms. Johnson may have asked easier 
questions during treatment). 

5. Statistical regression: a statistical law stating that a person who has been se- 
lected on the basis of his extreme scores will tend to score less deviantly 
upon further measurement. 


In a reversal research design, the reversal phase frequently involves 
a return to baseline conditions, as we have described in the text. How- 
ever, there are two other alternatives, either of which might be in- 
appropriate for particular research problems. To illustrate the first alter- 
native, consider Ms. Johnson's program for improving Billie's 
mathematics performance. Following the treatment phase, Ms. Johnson 
eliminated the reinforcement program. However, she might simply have 
delivered the one-minute additions to the physical education program 
(the reinforcers) on à noncontingent basis. This delivery of reinforcers 
independent of behavior during the reversal is one alternative b com- 
pletely eliminating the reinforcers, as described in the text, and is re- 


ferred to as an ABCB design. 


A second alternative is for the researcher to continue delivering 


i i liver it for any behav- 
the reinforcer during the reversal phase, but to deliv 
Breiner than the behavior that was reinforced during treatment (such 
as not doing math problems, in Billie's case). (This type of reinforce- 
ment schedule, called “DRO,” is discussed in Chapter 6.) A complete 
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reversal of the reinforcement rule during the reversal phase is likely to 
demonstrate very quickly whether or not the treatment was responsible 
for a behavior change, in that the reinforcer is now presented contin- 
gent on any behavior “other” than the behavior influenced during treat- 
ment. Examples of this variation during the reversal phase can be found 
in Bostow and Bailey (1969) and Kazdin (1973b). Leitenberg (1973) called 
this alternative a “true reversal design," and called the reversal-replica- 
tion design described in the text “a withdrawal design.” 


Multiple baselines across behaviors have demonstrated control over 
such behaviors as articulation errors (Bailey, Timbers, Phillips, and Wolf, 
1971), homework tasks (Hall, Cristler, Cranston and Tucker, 1970), aca- 
demic skills of hyperactive children in the absence of reinforcement 
(Ayllon, Layman, and Kandel, 1975), and problem solving by a commu- 
nity board (Briscoe, Hoffman, and Bailey, 1975). Other examples can be 


found in such journals as the Journal of Applied Behavior Analysis and 
Behavior Therapy. 
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Another type of design is the changing-criteria design (see Ax- 
elrod, Hall, Weis, and Rohrer, 1974). This design attempts to demon- 
strate stepwise changes in the dependent variable being studied corre- 
sponding to stepwise changes in the treatment. Axelrod et al. 
demonstrated control over cigarette smoking with this design by reduc- 
ing the daily cigarettes allowed in a stepwise fashion. If more than the 
allowed number of cigarettes was smoked per day, the client was re- 
quired to tear up a dollar bill for each cigarette smoked over the daily 
allowed amount. Additional discussion of this design can be found in 
Craighead, Kazdin, and Mahoney (1976). Another research design, one 
that is common in other areas of psychology, is the contro/-group de- 
sign. This design typically involves at least two groups, one that re- 
ceives the treatment and one that doesn't. The average performance of 
the two groups is then compared according to appropriate statistical 
procedures. Each of the other research designs described in this chap- 
ter focuses on the behavior of individuals. Control-group designs focus 
on the average performance of groups. For this and other reasons, con- 
trol-group designs have not been popular in behavior modification re- 
search. For additional discussion of a variety of control-group designs 
suitable for applied research, see Campbell and Stanley (1963). 


This is not meant to imply that statistical research designs are not 
utilized in behavior modification research. The “odd” statistical research 
design can be found in the Journal of Applied Behavior Analysis since 
its inception in 1968. Moreover, there has been a recent surge in sug- 
gestions of appropriate statistical techniques for research in applied be- 
havior analysis (for example, see Hersen and Barlow, 1976). Michael 
(1974) noted that the experimental and applied analyses of behavior 
have developed increasingly sophisticated and reliable methods of be- 
havioral control, and have done so largely without the use of statistical 
research designs that characterize other areas of psychology. He ar- 
gued, further, that because of this, and because the value of statistical- 
inference procedures for behavior modification has not been empir- 
ically demonstrated, applied behavior analysis should continue utilizing 
research designs such as those described in this chapter, rather than 
adopting statistical-inference procedures that are concurrently being 


recommended by some researchers. 


Baer, Wolf, and Risley (1968) have labeled this criterion of an applied 
study as technological. A study is technological when the procedures 
have been specified precisely enough so that a "typically trained reader 
could replicate the procedure well enough to produce the same results, 
given only a reading of the description. 

he tradition of behavior modification has been the ex- 
ceptional DE RES on objectivity and data taking, as indicated in Chap- 
ters 18 and 19 and throughout this text. Accompanying this emphasis is 
a strong tendency to publish procedures and results of behavioral ap- 

lications. Thus, although there appear to be no consistently applied 
iude Á one's data in order to judge whether or not a 


SACR ES ts for a particular behavioral change, the ten- 


sponsib 1 
Goat met pohavior modifiers to publish, and consequently to replicate 


; i If-correcting mech- 

indi others, has imposed an automatic se n | 
me jer d consistency of judgments from one behavior modi- 
PRS behavior publications can be found in a wide vä- 


i ese ip eke 
Te ic wvania from behavior modification journals to more 


local newsletters and publication outlets. 
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11. The therapeutic criterion of effectiveness is discussed in more de- 
tail by Baer, Wolf, and Risley (1968), and Risley (1969). 


Study Questions on Notes 


1. What do we mean by internal validity? 


2. Briefly list and describe the five classes of variables cited by Camp- 
bell and Stanley that threaten internal validity. 

3. What are some of the reasons why people do behavior modification 
research? 

4. Describe the details of the ABAB research design that Ms. Johnson 
might have applied in which the second A Phase would have been non- 


contingent reinforcement rather than a reversal. Can you say why this 
might have been an improvement over the design she used? 


5. Describe the details of an ABAB 
might have applied in which the 
reinforcement of any behavior other 
treatment phase, rather than a reversal. 
have been an improvement over the desi 


6. Besides the obvious differences in setting, 
between the Corte et al. study and the Hayes 
subtle difference. Can you identify that subtle 
studies? 


T. Briefly describe, with reference to an example, the multi-element de- 
sign. 


8. Briefly describe, with reference to an example, the changing-criterion 
design. 


9. Briefly describe the control-group statistical research design. 

10. Why did Michael argue against the use of the control-group statis- 
tical research designs in behavior modification research? 

11. Whatisa technological study? 

12. What is the Correction factor that tends to ke i ifi 
from utilizing invalid criteria in ES ioe 


analyzing the effects of their treat- 
ments? (In other Words, what keeps them honest?) $ 


dependent variables, etc., 
et al. study, there is a very 
difference between the two 
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DESIGNING A PROGRAM 
to Overcome 


A Behavioral Handicap 


In previous chapters, we described a variety of principles and proce- 
dures for overcoming behavioral handicaps (that is, behavioral defi- 
ciencies, excesses, or inappropriatenesses). It is probably obvious by 
now that most behavioral applications involve combinations of prin- 
ciples and basic procedures. We suspect that it is also obvious that 
one must make a number of decisions in designing and implement- 
ing a program that are not really a part of the scientific principles 
and procedures themselves. Some behavior modifiers are better than 
others at the “art’’ of program design and implementation. In the 
next five chapters, we will present a number of guidelines that will 
help you become proficient at designing specific types of behavior 
programs. This chapter provides general guidelines that should be 
followed when designing any type of behavioral program. The client 
might be a retarded child, a mental-hospital patient, a normal child at 
home, a normal child in a classroom setting, or perhaps a normal 
adult. The situation is one in which you, the behavior modifier, or a 
mediator (parent, teacher, or some other person) would be largely re- 


sponsible for carrying out the program. 


A PROBLEM HAS BEEN REFERRED: 
SHOULD YOU DESIGN A PROGRAM? 
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Behavioral handicaps have a variety of sources, exist in a variety of 
different forms, and differ widely in degree of complexity and sever- 
ity. The fact that a problem has been referred is not always sufficient 
reason for proceeding with program design and implementation. In 
order to decide where to begin or, indeed, if one should begin at all, 
it is helpful to try to answer the following questions: 


1. Was the problem referred primarily for the benefit of the client? 


2. Can the problem and the goal be specified such that you are dealing with 
a specific behavior or set of behaviors that can be counted, timed, or mea- 
sured in some other way? 

3. Is the problem important to the client or to others? 


. Have you eliminated the possibility that there are medical or psychologi- 
cal complications involved in this problem that would necessitate refer- 

ring the problem to another specialist? (In other words, are you the ap- 

propriate person to deal with this problem?) 

Is the problem one that would appear to be easily manageable? 

If the goal is reached, might it be easily generalized and maintained? 

Can you identify significant individuals (such as relatives, friends, and 

teachers) in the client’s natural environment who might help record ob- 

servations and manage controlling stimuli and reinforcers? 

8. If there are individuals who might hinder the program, can you identify 

ways of minimizing their potential? 

9. On the basis of 

daily schedule 

the program? 


Sv 


your tentative answers to these eight questions, does your 
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behaviors that define the problem, then you should probably stop 
here. If you do achieve agreement, it should be specified in writing, 
because people are sometimes forgetful and may later feel that you 
did not deal with the problem that they referred to you. 

Concerning question 3, there are several questions that one 
might ask in order to evaluate the importance of the problem. If the 
problem is an undesirable behavior, does it usually lead to much im- 
mediate aversiveness for the client or others? Will solving the prob- 
lem lead to much more positive reinforcement for the client or oth- 
ers? Will solving the problem be likely to stimulate other desirable 
behaviors, either directly or indirectly? If the answers to the above 
questions are yes, then it is likely that the problem is important. 
If the answer is no to some of these questions, then you might recon- 
sider your involvement with that particular problem. 

Concerning question 4, it should be obvious that if there is any 
chance that the problem has serious medical complications (for in- 
stance, excessive weight gain or loss) or serious psychological com- 
plications (for instance, the danger of suicide), the appropriate type 
of specialist should be consulted. You should then proceed to treat 
the problem if at all, only in a manner that is consistent with the rec- 
ommendation of that specialist. 

Concerning question 5, you might consider the following: If the 
major problem is to decrease an undesirable behavior, has the behav- 
ior been occurring for a short time, under narrow stimulus control, 
and with few instances of intermittent reinforcement? A problem 
having these characteristics is likely to be much easier to solve than 
an undesirable behavior that has been occurring for a long time, un- 
der the control of many stimulus situations, and with a history of in- 
termittent reinforcement. Moreover, you should be able to identify 
desirable behaviors that can replace the undesirable behavior. If the 
problem is to teach a new behavior, you should assess whether or not 
the client has the prerequisite skills. 

Concerning question 6, you should consider the following: Can 
the problem and the improved behavior be managed in the natural 
environment? If not, can a special training setting be developed that 
can easily be faded into the natural environment? You should also 
consider whether there are natural contingencies that will likely 
maintain the behavioral objective after it has been achieved, whether 
you can change the people in the natural environment ees jd 
help maintain the desired behavior, and whether it is puris iyi : 
client to learn a self-control program (discussed in Chapter 25) so tha 

i behavior will persist. ] 

i pat question 7 you must consider who is pierde 
help manage a program. For example, it makes little sense to accept a 


referral concerned with the development of a language-training pro- 


gram that will require approximately an hour of concentrated eftort 
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Putting it project, if the mother and father are separated, and if the mother 


all Together 


works full-time during the day and has four other children who oc- 


cupy her attention in the evening. 


Concerning question 8, it makes little sense for you to design a 


program if people are going to be sabotaging it all the time. When a 
behavior modifier first enters a ward for the retarded, the home of 
a family with a problem child, or the classroom of a second-grade 
teacher, the behavioral problems and the number and complexity of 
potentially disruptive influences are often mind-boggling. For obvi- 
ous reasons, it is better to start simply so as to succeed in a small 
way, rather than to attempt too much and risk failing gloriously. A 
careful evaluation of the initial referral in terms of the above ques- 


tions and considerations can often contribute greatly to the initial 
success of the behavior program. 


Concerning question 9, you should only accept those referrals 


for which you have adequate time to carry out an effective program. 


SELECTING AND IMPLEMENTING 
AN ASSESSMENT PROCEDURE 


Let's suppose that you have decided to proceed with designing and 
implementing a behavioral program for a behavioral handicap re- 
ferred to you. You might then proceed through the following steps: 


1 


ee behavioral handicap in precise behavioral terms, for reliable 


Select an appropriate baseline procedure (see Chapters 18 and 19) 
Select appropriate baseline itori T ei 
2 Ppr D procedures for monitoring potential side ef- 
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We reviewed the guidelines for defining, recording, and graph- 
ing behaviors in Chapters 18 and 19, and we will not repeat them 
here. However, there are some additional considerations that a be- 
havior modifier should review before, and during, assessment proce- 
dures. 

What are the daily times the mediator(s) can schedule for this 
project? If, for example, a teacher has about ten minutes per day just 
before lunchtime to devote to the project, it is senseless to design 
time-sampling data sheets that require her to assess behavior 
throughout the day. It is also senseless to gather data on a wide vari- 
ety of behaviors that the teacher will never have time to examine. 
Many behavior modification projects are killed before they start 
when the behavior modifier designs complex data-collection systems 
that the teacher doesn’t have a hope of using. 

Will others in the situation help or hinder your data collection? 
There is no sense in designing a baseline procedure to record the du- 
ration of a child’s tantruming in a home situation if a grandmother, 
an aunt, a brother, or other relatives are going to give the child a 
candy to stop tantrums because "they can’t stand seeing the poor 
little boy upset." On the other hand, friends and relatives can often 
be extremely helpful, either by directly recording data or by remind- 
ing others to do so. If the help of others is to be utilized, posting 
data sheets and a summary of the recording procedures where every- 
one involved in the project can see them (such as in a conspicuous 
place in the Kitchen) is usually a very desirable practice. 

Will the physical environment help or hinder your assessment? 
Let's suppose that you wish to take a baseline on the frequency and 
timing of a child's urinating and defecating throughout the day. If 
the house has many rooms and the child wanders through them, it 
may be difficult to immediately detect instances of the "dirty deed." 
Or suppose that someone wishes to take a baseline of smoking be- 
havior, but during the baseline spends some time in the house of a 
friend who doesn't smoke and doesn't have ashtrays around. Obvi- 
ously, this is not ideal for assessment procedures. If you wish to as- 
sess the basic self-dressing skills of a severely retarded individual by 
presenting clothing items with appropriate instructions, and the 
child's favorite TV program is blaring in the background, then your 
assessment is not likely to be accurate. 

What is the nature of the existing behavior? Is it a behavior that 
occurs frequently throughout the day in many situations, such as 
thumb-sucking, fingernail biting, whining, or pestering? Or is it one 
that occurs once every two or three weeks, such as occasional but se- 
vere tantrums, stealing, or running away from home? Is the behavior 
one that requires a quality assessment, such as dusting furniture or 
washing and drying dishes? In some cases, your answers to these 
questions might influence you to scrap the project. For example, a 
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1. Review the target behavior 


2. Identify individuals ( 
help manage controlli 
who might hinder th 


and the desired stimulus control. 


ight 
relatives, friends, teachers, and others) who is 
ng stimuli and reinforcers. Also, identify individua 
e program. 
3. Review alternative combinations of principles 


and procedures, 
a) If you are overcomin 


8 a behavioral deficit: 
(1) think of shortcut tactics first: 
(a) instruction (oral and/or written) 
(b) situational inducement (rearrange the surroundings, move the 
activity to a new location, relocate People, and/or change the 
time of the activity) 
(c) modeling 


you want to increase the fr 
behavior or establish a new behavior, 


(3) decide whether shaping or chainin 


b) If you are decreasing a behavioral exce 
(1) think of shortcut tactics first: 

(a) instructions 

(b) si 


equency of an existing 


8 is more appropriate. 
SS: 


(relocate people, change time of activ- 
) new location, and/or rearrange existing 
surroundings) 

(c) instructions and modeling 

(d) instructions and guidance 


(e (2) Can you try an indirect or partial solution? 
A Pronram (a) Eliminate early component of a chain. 
(b) For high-frequency behaviors, introduce new stimulus control 
and partial elimination. 
(3) Decide whether DRL, DRO, extinction, or punishment should be 


used. 
4) In all cases, consider alternative desirable behavior to be increased 


1) Select the controlling Ps such that they: 
(a) are different from other stimuli along more than one dimen- 
sion; 
(b) are encountered mainly in situations in which the desired 
stimulus control should occur; 
(c) evoke attending behavior; 
(d) do not evoke undesirable behavior. 

(2) Determine the current stimulus control of the desired behavior. 

(3) Decide how the current stimulus control can be faded so as to 
achieve the target stimulus control. (Remember that fading can oc- 
cur along any dimension: color, sound, room size, number of 
people, appearance of people, gestures, furniture arrangements, fa- 
miliarity, and so on.) 

4. Review the guidelines for the effective application of the selected prin- 
ciples at the end of Chapters 2-12. 


( 
c) If you are changing the stimulus control of an existing behavior: 
i 


Let us suppose that your problem is to overcome a behavioral 
deficit. The behavior that you wish to occur is not now occurring. 
You should then ask a number of questions designed to determine if 
one or more of the shortcut tactics cited above might be appropriate. 
Do any of the significant individuals in the client's life know of any 
instructions that might produce the desired behavior? Is there any 
significant individual whose modeling of the desired behavior the 
client might readily imitate? Is there any easily administered physi- 
cal-guidance procedure that, combined with fading, would produce 
the desired end product? Would the desired behavior occur if the 
existing surroundings Were rearranged? If the activity was moved to 
a new location or a new time? If significant people were made more 
obvious or less obvious? If anything from these shortcut tactics might 
be identified that will produce the desired behavior, then the prob- 
lem might be phrased primarily in terms of item 3c above— changing 
the stimulus control of the existing behavior. That is, if there are 
shortcut tactics that will produce the behavior, then it should 
identify some dimensions along which those con- 
an be faded in order to achieve the desired stimulus 
1 objective. If so, then you should examine very 
dividuals and the surrounding environ- 
der to select controlling SPs ac- 


some 
be possible to 

trolling stimuli ¢ 
control and behaviora 
carefully the surrounding individ) 
ment in relationship to the client in or 


cording to the guidelines cited above. | 
If your major concern is decreasing some undesirable behavior, 


there are also a number of preliminary considerations that should be 
reviewed, These inevitably amount to various strategies for increas- 


330 
Putting it 
all Together 


ing some desirable alternative behavior, as opposed to concentrating 
on the use of extinction or punishment to decrease the undesirable 
behavior. A thorough review of the problem behavior in terms of 
these considerations (see item 3b above, and Chapter 16) will 
frequently lead to effective and rapid decelerating procedures such 
that extinction and/or punishment are not the primary focus of atten- 
tion. 

After an appropriate combination of principles and procedures 
has been selected, the guidelines for their effective application should 


be reviewed prior to the explicit design and implementation of a pro- 
gram. 


STRATEGIES OF PROGRAM DESIGN AND IMPLEMENTATION 


Some behavior modifiers appear to be extremely skillfull at designing 
effective programs "off the top of their heads” —that is, identifying 
the program details critical to their success and designing programs 
that show quick, desirable results. There is probably no set of guide- 
lines for you to follow that will immediately turn you into that kind 
of behavior modifier. Nor are there any rigid sets of guidelines that 
you should adhere to for every program you design. Many behaviors 
can be managed successfully with a very minor rearrangement of 
existing contingencies, while others require much creativity. The 


following guidelines, however, will help you to design an effective 
program. 


I. Define the target behavior and identify its desired level of occurrence 
(i.e., frequency) and stimulus control. Then answer the 
a) Is the description precise? 


b) On what grounds was the goal chos h i he client s 
ó 8 l en, and i i : 
i " Ow is that in the client's 


se questions: 


E — the client been given all possible information about the goal? 
at are potential si ishi l 
a po erst side effects of accomplishing the goal, for both the 


e) Do the answers to these i 
questions su : 
If so, then continue, keeping in min qom i hanl meet 


a d the a C iderati 
2, 3, and 4 in the preceding section. il 


2. i i 
td ao a Positive alternatives (if any) that will 
me malc and 16 and considerations 3a and 3b in the 
3. Specify the details of the behav} 
= ponds e avioral-programming steps by answering 


a) What reinforcers will be used? 
b) How will shaping, fadi uni 
2 g. fading, ct d 
reinforcement be used? 8 chaining, token training, and schedules of 


c) What are the necessa 


"Herbs. Ty precurrent beh 


aviors, and how will they be 
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d) What problems might arise, and how can they be managed? 
. Specify the detai : i phi i 

P cih e d etails of Medati recording and graphing procedures. 
Specify the training setting. What environmental rearrangement will be 
necessary in order to maximize the desired behavior, minimize errors 
and competing behavior, and maximize proper recording and stimulus 
management by the mediators (those directly carrying out the program)? 
6. Specify the reinforcer system by answering the following questions: 

a) How will reinforcers be selected? (See Chapter 2.) 

b) How will reinforcer effectiveness be continually monitored and by 


Ui 


whom? 
c) How will reinforcers be stored and dispensed, and by whom? 
d) If a token system is used, what are the details of its implementation? 
(See Chapter 9.) 
Describe how you will assure generalization (Chapter 11) by: 
atural-environment situations similar; 


N 


a) making the training and n 
b) preparing for possible maintaining contingencies in the natural envi- 
ronment: 
(1) Shifting to natural reinforcers? 
(2) Reeducating the people in the natural environment? 
(3) Using intermittent schedules in the natural environment? 
(4) Teaching the client to maintain by using self-control (as discussed 
later in Chapter 25)? 
c) using more than one training situation. 
8. Collect the necessary materials (such as reinforcers, a reinforcer-storage 
system, data sheets and graphs, and curriculum materials). 
9. Make check lists of rules and responsibilities for all participants in the 
program (staff, teachers, parents, peers, students, the client, and others). 

10. Specify the dates for data and program reviews, and identify those who 
will attend. 

11. Identify some contingencies that will reinforce the behavior modifier(s) 
and mediators (in addition to feedback related to the data and program 
reviews). 

12. Review the potenti 
teacher time, profession 
merit against its cost. Repro; 
this review. 

13. Implement the program. 


al cost of the program as designed (cost of materials, 
al consulting time, and so forth), and judge its 
gram as necessary or desired on the basis of 


If you have followed all of these guidelines, the program is 
ready to go. The implementation of your program also requires a 
great deal of consideration. This might be done in two parts. First, 
you must be certain that those responsible for carrying out the pro- 
gram, the mediators, are emitting appropriate behavior. This might 
involve a detailed discussion and review session with the mediators. 
It may also involve some modeling and demonstration on your part, 
perhaps some role playing on the part of the mediators (depending 
on the complexity of the programs), and finally some on-the-spot 
feedback when the program is actually implemented, so that parents 
and/or teachers and/or others are encouraged to follow the program 


332 
Putting it 
all Together 


and are reinforced for doing so (see Martin, 1972). The second aspect 
of program implementation is introducing it to the client. It is obvi- 
ously very important that the initial contact of the client with the 
program be highly reinforcing, so that the probability of further con- 
tacts is increased. Presumably, a well-designed program will include 
a great deal of specific information for introducing the programming 
steps (as suggested in guideline 3) to the client. 


PROGRAM MAINTENANCE AND EVALUATION 


Is your program having a satisfactory effect? This is not always an 
easy question to answer. It is also not always easy to decide, by some 
criterion or other, what to do if the program is not having a satis- 
factory effect. We suggest reviewing the following guidelines in order 
to assess a program that has been implemented: 


1. Monitor your data to determine whether the recorded behaviors are 

changing in the desired direction. 

2. Consult the people who must deal with the behavioral handicap, and de- 

termine if they are satisfied with the progress. 

. Consult the behavioral journals, professional behavior modifiers, or oth- 
ers with experience in using similar procedures on similar problems to 
determine if your results are reasonable in terms of the amount of be- 
havior change during the period the program has been in effect. 

. If on the basis of guidelines 1, 2, and 3 the results are satisfactory, pro- 
ceed directly to guideline 8. 

If on the basis of guidelines 1, 2, or 3 your results are unsatisfactory, an- 

swer the following questions and make the appropriate adjustment for 

any yes answer: 

a) Have the reinforcers that are being used lost their appeal? 

b) Are the procedures being applied incorrectly? 


€) Is there outside interference from others that is disrupting the pro- 
gram? 


d) Are there any subjective variables — staff attitudes, teacher enthusi- 
asm, and so forth — that might be affecting the 
If none of the answers to these four questions 


ditional programming steps need to be added or removed. The data may 
Show excessive error rates, which would su 


i ggest the need for additional 
programming Steps. Or it may show excessive rates of correct responses, 
which would indicate that the Program is too easy and that a certain 
amound of boredom is occurring. Add, remove, or modify steps as nec- 
essary. 


program? 
are yes, check to see if ad- 


i; If the results are now satisfactory, Proceed to guideline 8; otherwise, re- 
design the entire program ) 


Identify the schedule that wi 
at will enable you t i iate pro- 
gram maintenance until the be / Ar ES 


: havioral objective is reached. 
ollowing attainment of the beh 


avioral goal, outline a propri ar 
Tangement for assessing perform F E 


ance during follow-up observations. 
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. Where po: 


After successful follow i 

E -up observations have b i 
[eta ul i een obtain - 
benefit analysis on the basis of all the information EET T 
ble and appropri nd 

E iate, analyze your d 

i ssil i " 5 ) ata and communi 
your specific procedures and results to other behavior modifi D. 
terested individuals. S 


Study Questions 


(for examination purposes) 


We 


What is the purpose of this chapter, and how does this chapter relate to 
the other chapters in the book? 


Evaluating the Referral 


2 . 


ae 


6. 


Assume that you are a professional behavior modifier. List at least four 


possible conditions under which you would nof treat a behavior problem 


that has been referred to you. 

What does a behavior modifier do w 
"aggression") to work on? 
How does a behavior modifier evaluate the importance of a problem? 
How does a behavior modifier evaluate the ease with which a problem 
might be solved? 
a behavior modifier evaluate the ease with which the desired 
be generalized to, and maintained in, the natural 


hen given a vague problem (such as 


How does 
behavior change might 
environment? 


Preliminary Considerations of Program Design 


is 


8. 


9, 


Strateg 


10. 


11. 


If you are thinking of overcoming a behavioral deficit, state four shortcut 


hat you might consider. 
thinking of decreasing a behavioral excess, describe two in- 
ons you might consider. 

the stimulus control of an existing be- 
you consider—and in what order? (Do 


tactics t 
If you are 
direct or partial soluti 
If you are thinking of changing 
havior, what three steps should 
not list the substeps.) 


ies of Program Design and Implementation 

reatment program. However, after defin- 
entifying its desired level of occurrence 
stions should you answer before pro- 


bout to design a t 
havior and id 
ol, what four que 


You are now a 
ing the target be 
and stimulus contr 
ceeding to the design? 

In designing à behavioral program, ! 
cide to rearrange the training environmen 


ample of each. 


m, for what three reasons might vou de- 
t (guideline 5). Give an ex- 


334 
Putting it 
all Together 


12. What factors should you consider in programming for generalization? 


13. How can you increase the likelihood that the client's initial contact with 
the program will be favorable? 


Program Maintenance and Evaluation 


14. After a program has been implemented, what three things should be 
done to determine whether it is producing satisfactory results? (guide- 
lines 1, 2, and 3) 


15. If a program is producing satisfactory results, what two things should 


be done prior to successfully terminating the program? (guidelines 8 
and 9) 


16. Describe in detail the steps that should be followed if 


a program is not 
producing satisfactory results. (guidelines 5, 6, and 7) 


Study Exercise 


(to be practiced by the reader) 


Suppose that you are a behavior modifier. 


year-old child asks for your help in designing a Program to overcome the 
child's extreme disobedience. Construct realistic but hypothetical details of 
the behavior problem and take it through all the 


. The mother of a "normal" four- 


t n Steps in each of the follow- 
ing stages of programming: 
a) deciding whether you should design a program to treat the 
problem 


b) selecting and implementing an 

€) preliminary considerations of p 

d) strategies of program design 

€) program maintenance and ev. 

(Note: The problem will have to be fairl 
through all of the steps ine 


assessment procedure 
rogram design 

and implementation 
aluation 


y complex in order for you to take it 
ach of these stages.) 


Self-Modification Exercise 


(to be practiced by the reader) 


Suppose that you area b 
overcoming problems of 


and a client asks for your help in 
(or boyfriend). Construct 


concerning his ( 
Pothetical detai 


a) deciding whether 
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TOKEN ECONOMIES: 


Factors to Consider 


When Designing One 


Conditioned reinforcement was first defined and discussed in Chap- 
ter 9. In that chapter, a conditioned reinforcer was defined as a stim- 
ulus that is not originally reinforcing, but that acquires reinforcing 
power from being paired appropriately with other reinforcers. Some 
conditioned reinforcers, such as praise, are quite brief. The stimulus 
is gone almost as soon as it is presented. Other conditioned rein- 
forcers, such as money, endure until they are exchanged for back-up 
reinforcers, such as food. Conditioned reinforcers of the latter type 


are called tokens.' 

A program employing tokens with 
called a token economy. The types of groups with whom token econo- 
mies are used include psychotic patients in institutions and halfway 
retarded individuals and multiple disabled individuals in in- 
and sheltered workshops; juvenile 
in correctional institutions and 


a group of individuals is 


houses; 
stitutions, day-care centers, 


delinquents and "'predelinquents" 
group homes; criminal offenders in prisons; slow learners and emo- 


tionally disturbed children in private schools and special-education 
classes; armed forces personnel; welfare recipients; nursery school 
children, normal school children and adolescents in all grades; and 
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college students. Clearly, the ability to design and manage a token 
economy in a wide variety of settings is a useful skill for behavior 
modifiers. The purpose of this and the next two chapters is to de- 
scribe the considerations involved in designing and setting up an ex- 
tensive token economy for a group of individuals. Considerations for 
designing a more limited token system for a single individual would 
be similar, although less detailed. 


ADVANTAGES OF A TOKEN ECONOMY 


In deciding whether or not to use tokens, one has to weigh the ad- 
vantages and disadvantages of doing so in specific training situ- 
ations. Tokens are usually cumbersome to deal with and the time and 
effort spent in handling them may distract both the client and the be- 
havior modifier from important aspects of the learning task. In addi- 
tion, most natural environments do not provide tokens for desirable 
behavior. One of the few exceptions is working at a job, which is re- 
paid with money. Therefore, transfer to the natural environment usu- 
ally requires weaning the individual from tokens, which is not the 
case (at least not to the same extent) when conditioned reinforcers 
Such as praise are the only type used. 

On the other hand, there are a number of advantages to using 
tokens. First, tokens help to make reinforcement more effective for 
several reasons: (a) The most important reason is that they can be 
given immediately after a desirable behavior occurs, and can be 
cashed in at a later time. In this way, they can be used to "bridge" 
very long delays between the response and the back-up reinforcer. 
This is especially important when it is impractical or impossible to 
deliver the back-up reinforcer immedia 
(b) With tokens, the amount of any giv 
immediately obvious and can be easi 


pending on important aspects (such as quality, effort involved, and 
probability) of the desired beh 


avior. True, the magnitude of condi- 
tioned reinforcers such as Praise can also be adjusted. One can whis- 
per "good" or one can shout "GOOD." One can vary the magnitude 


of praise by using adjectives to form expressions such as "pretty 
good" and "very good." One can use different terms of approval, 
such as "not bad" and "excellent." One can even repeat "good, good, 
good, ..." until an appropriate number have been delivered, al- 
though this could become tiring to both the Praiser and the "'praisee" 
if the desirable behavior is highly praiseworthy. Finally, one could 
combine all of these methods — for instance, “Good! Wow, that was 
teally good! Great! Good for you!” But it must be conceded that the 
Variation is not very precise, and its range is limited. Tokens, on the 
other hand, are Precisely quantifiable (there is no question that two 


tely after a desirable response. 
en instance of reinforcement is 
ly increased or decreased de- 
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tokens, for example, are twice as many as one), and a large number 
can be quickly delivered. If the numbers to be delivered become un- 
wieldly, denominations can be formed like those in our money sys- 
tem, where one dollar, for example, is worth one hundred pennies. 
(c) Tokens permit an individual to see his progress in a tangible 
form. If the program is well designed, the number of tokens an indi- 
vidual collects will correlate with the improvement in his behavior. 
To the extent that this improvement is reinforcing to the client, it will 
add to the reinforcing power of the tokens and thus help increase the 
rate of improvement. (d) The type of praise delivered can vary 
greatly, depending on the mood of the praiser. If the praiser is in a 
“bad mood,” the praise delivered may not be too reinforcing, espe- 
cially if the "bad mood” is reflected in a tone of voice that lacks en- 
thusiasm. However, a token is always a token, and its value does not 
vary with the mood of the person delivering it. 

j Second, tokens provide stimuli that control the teacher's behav- 
ior more effectively. Other conditioned reinforcers, such as praise, do 
not provide this same stimulus control. (a) Tokens in the hands of 
the behavior modifier serve as an additional S" to remind her to rein- 
force the student's appropriate behavior. If the behavior modifier car- 
ries a lot of tokens, their sheer weight will probably provide an S" 
and perhaps even a reinforcer in the form of a lighter load, for hand- 
ing them out. (b) Token delivery can act as an S? for delivering other 
conditioned reinforcers, such as praise. As we noted above, tokens 
are more likely to be given out than praise. It follows, therefore, that 
praise will probably be awarded more often when tokens are used 
than when tokens are not used (see, for example, Breyer and Allen, 
1975). Staff should, of course, be instructed. to praise when they 
award tokens, and should be reinforced for doing so. (c) Token deliv- 
ery can act as an SP for another important staff behavior: keeping 
data on student behavior. When the tokens are stars on a chart or 
marks on a piece of paper, awarding tokens and recording desirable 
behavior are equivalent. A I. 

Third, besides being an effective motivating device, tokens are 
also a teaching tool. (a) Their use can help to teach simple arithmetic 
and some of the behaviors involved in working for and dealing with 
money. In cases where these behaviors are deficient, this could be a 
factor that leads to a quicker transfer to the natural environment. (b) 
Students can learn important self-management skills if they are 
taught to deliver their own tokens, as described in Chapter a 
These advantages become more important when one is dealing 
i s rather than single individuals. As the number of clients 
T. dk senis increases, it becomes more difficult to administer 
per sta RAP effective programs for all clients. Tokens provide a 
e h programs. In addition, they might 


2 ; é 
ncrete basis for managing su ; x ae ERTE, 
mde possible greater efficiency through increased specialization: dif- 
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ferent staff members can be assigned different jobs having to do with 
dispensing tokens for specific behaviors and awarding back-up rein- 
forcers. Some routine jobs can even be automated, thereby freeing 
the staff for more complex training functions. For example, by using 
tokens that will operate automatic equipment, such as timing devices 
on TV sets, vending machines for candy, cigarettes, and other rein- 
forcing items, and turnstiles giving access to areas where movies, 
dances, parties, and other reinforcing activities are available, the staff 
may be freed from the job of having to dispense these reinforcers. 
Chapter 21 discussed the considerations involved in designing 
procedures for dealing with specific behavioral handicaps. The very 
same considerations are appropriate for designing token economies, 
because a token economy is a set of procedures— more complex than, 
but fundamentally the same as, those described in the previous chap- 
ters — for dealing with specific behavioral handicaps. The main differ- 
ence is that a token economy deals simultaneously with a number of 
target behaviors of a number of different individuals. To avoid exces- 
sive repetition, we will not stress these considerations. Instead, we 
will emphasize considerations specific to designing token economies. 


CONSIDERATIONS IN DESIGNING A TOKEN ECONOMY 


Deciding what you need to know 


Although some people have started a token economy with little 
background knowledge other than that provided by their own good 
judgment and common sense, we would not generally endorse this 
approach. Instead, we would recommend that the designer of a token 
economy first master, as a bare minimum, all of the material covered 
in Chapters 1-24 of this text. In addition, the designer should read 
some current literature describing token economies that h 
used with the specific types of individuals with whom sh 
cerned. Since new findings are being made constantly, and old ones 
confirmed, expanded upon, and Sometimes even found to be faulty, 
we strongly recommend that token-economy designers, managers, 


and directors never neglect the most recent issues of the behavior 
modification journals. 


ave been 
e is con- 


Deciding on your target behaviors 


The target behaviors will be determined 1 
individuals with whom you are working; by 
long-range objectives you wish to accomplish wi 
and by specific behavior problems you are enc 


argely by the type of 
the short-range and 
th those individuals; 
ountering that inter- 
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fere with the realization of those objectives. For example, if you are 
the classroom teacher of a bunch of rowdy first graders, your objec- 
tives will likely include teaching printing, counting, addition, sub- 
traction, and constructive social interaction. Your target behaviors 
would include behaviors that are involved in these skills or pre- 
requisite to them. Thus, at least one of your target behaviors might 
be “sitting quietly when the teacher gives out instructions." A more 
advanced target behavior might be "correctly completing problems in 
a workbook." If you are a college instructor, your objectives would 
not be substantially different. Instead of a workbook, however, you 
might use a list of study questions and exercises— such as those in 
this text— that cover all of the concepts and skills you wish to teach. 
Target behaviors would be acceptable responses with respect to the 
study questions and exercises. If you are a psychologist or psychia- 
trist in charge of a psychiatric ward, your objectives will probably in- 
clude establishing normal types of behavior, such as self-care skills, 
meaningful social interaction, appropriate verbal behavior, and pro- 
ductive work. In our view, a behavior modifier should always strive 
to ensure that the behaviors he establishes in his clients will even- 
tually prove useful to those individuals in the natural environment. 

The more homogeneous the group with whom you are dealing, 
the easier it is to standardize the rules concerning which specific re- 
sponses will be reinforced. with what specific number of tokens. 
From this perspective, at least, it is fortunate that many groups for 
whom token economies are appropriate are composed of individuals 
who are at roughly the same behavioral level (for example, severely 
retarded individuals, or college students enrolled in introductory 
physics). However, even with very homogeneous groups, it will 
probably be necessary to have some specific reinforcement rules for 
certain individuals, according to their respective behavioral tee 
This necessity for individualizing programs adds to the complexity o 
administering a token economy, but the resulting difficulties are not 
serious if a staff member is not required to handle too many radically 
different individual programs at once. Assigning special cases to spe- 
cial-treatment groups may be one efficient way in which to solve the 
problem of individualization in certain types of settings. 


Taking baselines 


s before initiating other procedures, one should 
obtain baseline data on the specific target behaviors before initiating 
a token economy. It may be that your clients are already performing 
at a satisfactory level and that the potential benefits to be gained 
from setting up a token economy do not justify the time, effort, and 


cost involved in doing so. 


Just as one doe: 
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Selecting back-up reinforcers 


The methods for selecting back-up reinforcers are essentially the 
same as the methods for selecting reinforcers (described in Chapter 
2). Keep in mind, however, that a token system will generally in- 
crease the variety of practical reinforcers that you can use. Take into 
account the kinds of things that are generally effective reinforcers for 
the type of individuals (children, adults, or whomever), with whom 
you are working. Use the Premack Principle (see p. 22), including 
noting what individuals buy with their tokens after the token econ- 
omy is initiated, and obtain verbal information from the clients con- 
cerning their reinforcers. For some groups of individuals, verbal in- 
formation may be difficult to obtain. Ayllon and Azrin (1968b) 
increased the amount of this information by reinforcing spontaneous 
requests of mental patients (such as “Gee, I'd sure like some 
scrambled eggs for breakfast for a change!”’) as quickly as possible 
with the requested items. In addition, "on a regular schedule, an at- 
tendant was assigned to ask each patient on the ward whether there 
was anything she would like to have. This formal procedure was de- 
signed to obtain more requests than would have resulted had only 
the spontaneous request been made" (Ayllon and Azrin, 1968b, p. 69). 
Catalogues were made available to patients as a means of helping 
them specify items that would be reinforcing to them. 

Back-up reinforcers may, of course, be 
erating budget will allow, but it is encouraging to note that many 
highly effective reinforcers need not be expensive at all. Before rush- 
ing out to purchase items, you should first consider using reinforcers 
that are already available in your system and that involve little or no 
added cost. Free time, the opportunity to play with toys or read 
books, field trips, early recess, recess itself, refreshments, and even 
the opportunity to help the teacher are all examples of reinforcers 
that are freely available in many classrooms. Access to the dining 
hall, eating in an attractive setting (for instance, at a table with a ta- 
blecloth, comfortable chairs, good silverware, and candles 
on a comfortable bed rather than a cot, and attending picnics, parties, 
dances, and the movies have been used as back-up reinforcers for 
mental patients. The opportunity to watch television and access to 
the game room have been used as reinforcers for juvenile delin- 
quents. High grades, being allowed to miss classes, and completing 
coursework before the end of the normal academic term appear to be 
effective back-up reinforcers for most college students. 

In considering reinforcers that are normally available, however, 
one should take extreme caution to avoid the serious ethical prob- 


as expensive as your op- 


), sleeping 


. mber of court decisions 
rights of patients. One should, therefore, 
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never plan a program which might involve depriving an individual of 
something that already legally and morally belongs to him.? 

Although back-up reinforcers are available at no cost in many 
settings, it is generally desirable or necessary to also use back-up re- 
inforcers that must be bought commercially. It is usually important to 
have as wide a variety of back-up reinforcers as possible (especially 
in the early stages of the program), and it is also usually important to 
have some, such as candies, that can be delivered and consumed very 
quickly. Most purchases, however, can be relatively inexpensive 
ones. More work can be required for more expensive items, so that 
they are not used up more rapidly than your budget can afford. In 
addition, more expensive items— for example, a bicycle— can be rented, 
rather than sold, for tokens. In this way, they can be reused many times 
as back-up reinforcers. 

Although there is a great deal of flexibility in the cost of run- 
ning a token program, having some extra funds is often highly desir- 
able. Additional funds might be obtained from administrators of in- 
stitutions and/or appropriate government agencies at various levels— 
for example, city school boards, or state, provincial, or federal depart- 
ments of education or health. Inquiries to such agencies might reveal 
that there are special boards set up to grant funds to innovative 
projects in the category of your proposal. A well-thought-out, well- 
written proposal showing exactly how much money is needed, ex- 
actly how it is to be spent on a daily or weekly basis, exactly how the 
program will work (including solutions to anticipated problems) and 
the short-range and long-range benefits expected from the program 
(preferably in terms of future overall savings of money to the in- 
stitution as well as increased benefits to its clients) must usually be 
nted to those who provide this support. Such a proposal will 


prese: I 
: able in guiding the designer of a token economy 


also prove invalu 
when it is put into effect. ; t Y 
Donations from the general public, private organizations, civic 
organizations, and community-action groups are other possible 
sources of funds. For example, in conducting a token economy with 
welfare recipients, Miller and Miller (1970) were able to obtain contri- 
butions (not only of money, but also of used appliances otherwise 
destined for attics, basements, garages, and junkyards) from people 
iber: itical persuasions. 
si d oradtished what your back-up reinforcers are go- 
d how you are going to obtain them, you should next 
consider the general method of dispensing them. A Store or com- 
i is an essential feature of most token economies. In a small 
Nr eds h as a classroom, the store can be quite simple— 


n economy, suc š 
von a box located on the teacher’s desk, or another table in the room. 
Pu pone token economy, such as a mental institution, the store 
n a la £ 


would typically be much larger perhaps occupying one or more 
ooms. Regardless of the size of the store, a definite method of keep- 
ri 5. 


ing to be an 
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ing records of purchases must be devised so that an adequate in- 
ventory (especially of items in high demand) can be maintained at all 
times, within the limit of your budget. 


Selecting the type of tokens to use 


Tokens can take on any of the forms that money has assumed 
(including clamshells, if nothing better is available). Poker chips are 
often used, but personal “checks,” entries in a 
a chart on the wall or in notebooks carried by clients, stars or stamps 
to be pasted in booklets—all these and numerous other possibilities 
may suit the needs of your particular token economy. 

The main considerations in selecting the type of token are the 
type of clients with whom you are dealing and the setting. For very 
small children and severely retarded individuals in a classroom, the 


“bankbook,” marks on 


TOMMY, You 
HAVE SO 
MANY TOKENS, 


FIGURE 22.1. 


"Tokens should not be easily counterfeited.” 
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pegboard system described in Chapter 9 seems ideal. The number of 
tokens earned is always clearly in full view in front of the child, and 
the tokens are held firmly in place by the pegboard so that they are 
not dropped or played with excessively. Chain tokens—tokens that 
can be linked together—can be used for kindergarten children, For 
high school and college students, marks entered on some sort of 
record sheet are generally adequate. Even the more abstract types of 
tokens should be easily available for inspection by the client when- 
ever she wishes to review the number she has earned. 

In general, tokens should be attractive, lightweight, portable, 
durable, easy to handle, and, of course, not easily counterfeited, If 
automatic dispensers of back-up reinforcement are used, you should 
insure that your tokens will operate those devices. You should also 
insure that you have an adequate number of tokens for your clients. 
Stainback et al. (1973) suggest that one should have on hand about 
100 tokens per child when starting a token economy in the classroom. 

One should acquire the necessary accessories for handling and 
storing tokens. For example, schoolchildren may need boxes, bags, or 
purses in which to store the tokens they have earned. A teacher 
should have an apron with large pockets, a money pouch, or what- 
ever he needs in order to always have enough to be able to dispense 
immediate reinforcement. The cost of tokens and token accessories 
should be included in the budget submitted with the proposal men- 


tioned above. 


Identifying available help 


Help from other individuals may not be essential ina small to- 
ken economy, such as a classroom, but it is certainly to be desired — 
especially in the initial stages of the program. In a large token econ- 
omy, such as a large ward in a mental institution, such help is essen- 
"e The first source of help to consider is people already assigned to 
work with the clients. Teacher's aides and teaching assistants are of- 
ten assigned, in apprenticeship roles, to schoolteachers and college 
instructors, respectively. Nurse's aides are assigned to help with 
ward routines in institutions for mental patients, retarded people, etc. 
If a teacher's aide helps to teach, through helping to manage a token 
economy, then he is doing his job. If à nurse's aide successfully uses 
tokens to reinforce self-dressing behavior by the patients for whom 
she is responsible, then she is doing that part of her job that involves 

i ients to dress. 

BEC pce elastics! background other than that normally re- 
quired by one's present duties appears to be necessary for employees 


whose help in managing a token economy is to be enlisted. For ex- 
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ample, no special criteria were used in selecting the nurse’s aides 
who helped manage Ayllon and Azrin’s (1968) token economy with 
mental patients. None of those workers had ever attended college, 
and some of them did not have high school diplomas. 

Volunteers constitute another source of potential help. Civic or- 
ganizations and community-action groups in your area may be able 
to provide such individuals. Also, by checking with friends and ac- 
quaintances you might be able to locate homemakers, retired couples, 
or senior citizens who are able and willing to become involved in an 
interesting and worthwhile project. Departments of psychology, edu- 
cation, social work, physiotherapy, occupational therapy, and nursing 
at nearby colleges and universities might also be contacted with 
fruitful results. Many professors would look favor 
their students in the valuable learning experience 
ing to manage a token economy. 

Behaviorally advanced individuals withi 
constitute yet another source of potenti 
scientious fifth graders might be enlisted for part of one day per 
week to help manage a token economy for first graders. The small 
amount of time they spend outside of their classes to Participate in 
the first graders’ token economy can easily be justified on the basis 
of the important social skills they thereby learn — including individual 
initiative, responsibility, and helping to teach those who are less 
knowledgeable than themselves. With similar justification, college 
students in more advanced courses might help manage token econo- 
mies ies pecie in less advanced Courses, Reasoning that teaching a 
particu ar su ject matter is an excellent Way to master it, a number of 
university departments offer courses for which 
academic credit by acting as an assistant in 
he has previously taken and Passed with a 
department that does not have such 


ably upon involving 
S provided by help- 


n the institution itself 
al help. For example, con- 


à COurse Probably has courses 


iptions are 
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some youths served with remarkable effectiveness, despite having 
very little adult supervision and no specific training, as therapists for 
others who had speech problems (Bailey, Timbers, Phillips, and Wolf, 
1971). In token economies in college and university classrooms stu- 
dents who are among the first to master an assignment have served 
to evaluate the performance of other students on that assignment, 
and to give them immediate feedback concerning their performance. 
Another method used in college and university classes is to give the 
students a test near the beginning of the term on the first several sec- 
tions of the course material. Those students who demonstrate on this 
test that they can readily master the course material are each put in 
charge of a small group of students, whom they help tutor and super- 
vise throughout the remainder of the course. 

In deciding how you are going to obtain workers who will help 
manage your token economy, you will need to consider how their 
helping behavior is to be reinforced. Ideally, your client’s improve- 
ment will be a strong reinforcer for your workers. Your approval is, 
of course, a potential reinforcer that should be used generously. Per- 
mission to continue working in the token economy and to work at 
desired jobs are additional reinforcers at your disposal. For volun- 
teers, few or no potential reinforcers other than those just listed are 
available. This is one reason why volunteers do not, as a rule, make 
the best helpers. (However, reinforcers such as coffee, lunches, and 
parties could be programmed for volunteers.) But for paid employees, 
additional potential reinforcers include wages, salary increases, pre- 
ferred work shifts, extra time off the job, and preferred holiday and 
vacation times. For students working in your token economy in par- 
tial fulfillment of a course requirement, credit towards grades is a 
good potential reinforcer. For clients who help in the running of their 
own token economy, the most obvious reinforcers are, of course, to- 
kens. Paying tokens for the help of your clients is usually more than 
justified by the many useful behaviors (independence, initiative, re- 
sponsibility, helpfulness, social maturity, and so forth) that are 


thereby strengthened in them. 


Location and Apparatus 


In designing their token economy in a mental institution, 
Ayllon and Azrin (1968) initially assumed that a completely closed 
ward would be necessary for effective control of the reinforcers that 
were received by the patients, for accurate recording of responses, 

dequate supervision of patients and staff. But they soon re- 
= "ys t many desired responses and many effective reinforce- 
enia bue occur only outside of the ward. "The solution was to al- 


low availability of all those reinforcers and responses by creating an 
o J 
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open system in which access was regulated but never prevented” 
(Ayllon and Azrin, 1968b, p. 194). 

For similar reasons, similar freedom of movement seems desir- 
able in classroom token economies. Open-area classrooms are ideal, 
but not essential. College instructors using token economies often ar- 
range to have their courses scheduled in lecture halls or very large 
classrooms originally designed for at least twice as many students as 
the number anticipated to attend class at any given time. Movable 
desks are generally preferred over stationary ones because they en- 
able students to work easily in small groups. Classrooms with token 
economies are often very noisy places and give the initial impression 
of mass confusion to a casual observer. Surprising as it may seem, 
however, almost all students soon adjust quite well to the noise, so 
that it does not prevent them from working with great efficiency. 

No special apparatus is necessary for the functioning of a token 
economy. Ayllon and Azrin had continuous-surveillance devices 
(one-way windows, TV cameras, and microphones) installed on their 
mental hospital ward, only to find that such devices were not only 
unnecessary but also impractical to utilize. Automatic devices for dis- 
pensing reinforcement, which we mentioned earlier in this chapter, 
were found to be somewhat useful, however. Teaching machines that 
automatically dispense reinforcement (including tokens) for correct 
responses can be purchased from commercial firms. These and other 
type of aching aides an be especially useful in token economie 

quipment in your token economy, be sure 


to itemize it in the budget that you present with your proposal to the 
administrator of your institution and to various governmental and 
granting agencies. 


A SUMMARY OF CONSIDERATIONS IN 
DESIGNING A TOKEN ECONOMY 


1. Review some appropriate literature. 
2. Identify your target behaviors. 
a) 
b) 
c) 


List some short-range and long-range objectives 
Arrange your objectives in order of priority l 


Select those objectives that i 
ol are most r i 
are prerequisites to later objectives APADA Ene Neen aS SU 
d) Identify several of the ab i 
al. ove-mentioned priority objectives ich to 
se emphasizing those that can be atopia caste — 
e) Pinpoint a number of tar: i ia 

EM get behaviors for each of the starting objec- 
3. Take a baseline on your target behaviors 
4. Select your back-up reinforcers, l 


a) Use reinforcers that are i 
Hee usually effective with the Population of inter- 
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b) Use the Premack Principle. 

c) Collect verbal informati i i 

A EIE ‘ ion from the clients concerning their reinforcers. 

ive the clients catalogues that will help them identify reinforcers 

e) Identify a variety of “free-time” reinforcers. : 

f) Identify natural reinforcers that might be programmed 

g) If necessary, talk to administrators, government agencies, private orga- 
nizations, civic organizations, community-action groups and the c 
eral public in regard to funding your program. i 8 

h) Consider the ethics and legalities regarding the reinforcers on your list 

i) Design an appropriate store to keep, display, and di j 

i T: is k 

up reinforcers. siti SENT SRE 

Select the most appropriate type of token for i 

t 10s F your clients. (They should b 

attractive, lightweight, portable, durable, easy to handle, and pes eas i 

counterfeit.) T 

Identify those who are available to help manage the program. 

a) existing staff 

b) volunteers 

c) university students 


d) residents of the institution 
e) the members of the token economy themselves (plan to reinforce the 
helpers) 

Obtain an appropriate location and 
a) Accept the location with the greater space. 

b) Equipment and furnishings should be easily movable. 

c) Rearrange the setting so that behaviors of the clients can be detected 


most easily and reinforced immediately. 


necessary equipment. 


Study Questions 
(for examination purposes) 


$c 


. List the seven major categories © 


What is a token economy? 
In what four ways do tokens help make reinforcement more effective? 


In what three ways do tokens provide stimuli that help control the behavior 


of the behavior modifier? 


at two ways are tokens an effective teaching tool? 


Inwh 
f considerations in designing a token 


economy. 

What do we mean by 
concept to the design o 
What are two solutions 
up reinforcers? 


the phrase "serious ethical problem"? Relate this 


f token economies. 
to the problem of managing very expensive back- 
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15. 


16. 


17. 


n 


What are the sources of funds that you might explore before designing a 
token economy? 


What is the store of a token economy? Give examples. 


. Suppose that you are designing tokens for individuals who can read. De- 


sign a paper token with all the necessary information on it such that the 
token could also be used as a source of data when collected in the store. 
(Hint: amount? behavior? date? time? etc.) 


- What six characteristics should a token have? 
. How many tokens should you have for each student in the group? 
- What are the three problems of token storage that must be considered? 


(Hint: teacher, student, store) Briefly discuss solutions to the problems. 


. People who help manage a token economy must have a Ph.D. Right? Ex- 


plain. 


Briefly identify three sources of potential volunteer help in managing a 
token economy. Briefly identify three sources of help from within the 
setting of the token economy. 

What are the advantages in having the membe 


À | ts of the token economy 
themselves function as the main source of help? 


Briefly describe three considerations in selecting the best location for a 
token economy. (Hint: space? regulation? supervision?) 


Study Exercises 
(to be practiced by the reader) 


1 


e a eee s individuals of your choosing (for instance, in an elemen- 
ET schoo! GlaSSKOOMy A university class, or a ward in an institution for 
the retarded), identify five plausible goals for a token economy 


2. Precisely define the target behaviors related i i 

ug seins ment ated to each of the five goals listed 
3. Describe a number of things you migl i i 

er o £ht do to identify back. i cers 
for the group of individuals you chose in study ue e —— 
Much of the material in this and the next 
the 3 two ch i i 

greater detail in the following major works on gu n 
and Azrin (1968b), which deals with token economies in mental po 


college and high school courses 
(Continued) 


the use of token-economy procedures in 
; In which systems incorporating these 
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(Continued) 

procedures are sometimes called Personalized System of Instruction, or 
the Keller Plan (after F. S. Keller, 1968), see Johnston (1975), Keller and 
Sherman (1974), Kulik, Kulik, and Carmichael (1974), Ryan (1974), and 
Sherman (1974). i 


However, Martin (1975, pp. 84-85) pointed out that legal restraints 
on reinforcer use need not prevent the development of a token econ- ; 
omy. Individuals must receive nutritional meals and (in some in- - 
stitutions) access to common rooms equipped with a television set, but 
it may be possible to use such things as special desserts, being first in 
line for lunch, and personal television sets in bedrooms (for example, 
see Cohen and Filipczak, 1971) as reinforcers. Thus, with some creative 
arrangement, basic items can still serve as reinforcers. 


However, check this out with your workers' union, if they have one. 
Quite understandably, the workers may not view the matter in this way. 
Moreover, their job description may very well bear them out. S 


Study Questions on Notes 


1. What source texts might you recommend for someone interested in 
developing a token economy in a mental hospital? In an elementary 
school classroom? In a sheltered workshop? j 

2. Considering that laws in many areas require that individuals be given 
such basic items as their meals and access to recreation, how might it 
be possible to work such items into a token economy? 


CHAPTER 23 


Engineering 


A TOKEN ECONOMY 


Chapter 22 discussed the materials, tools, equipment, facilities, and 
personnel necessary for setting up a token economy, and how to go 
about obtaining them. The present chapter deals with the engineer- 


ing—that is, the designing and managing —of a smoothly function- 
ing, effective token economy. 


MORE ABOUT MANAGING THE REINFORCERS 


We cannot overemph 
contingencies related 
for back-up reinforcer 
areas. 


asize the importance of attending closely to the 
to tokens, token delivery, and token exchange 
S. In this section we comment further on these 


Making Tokens Reinforcing 
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tokens can purchase is usually sufficient. For example, simply telling 
college students that 500 points earned throughout the course term 
may be exchanged for an A, 450 points for a B, and so on, appears 
(from our experience) to render a point a very strong reinforcer for 
most students. 

Frequently, however, clients require some initial token training. 
Thus, in the early stages of many token economies, a client will im- 
mediately be given a back-up reinforcer in exchange for one token 
that he has just earned. For example, a mental patient may be denied 
entry to a party because he lacks the one-token entrance fee. But at 
the same time he will be given an immediate opportunity to acquire 
the necessary token by performing a simple task. For example, he 
may be asked to perform the simple social task of conversing for a 
moment with a specific staff member, who in return will immediately 
give him the required token. 

For completely unsophisticated clients, such as very small chil- 
dren and severely retarded individuals, training procedures involving 
prompting, fading, and chaining will be necessary for establishing 
tokens as reinforcers and teaching the clients how to use them. Such 
training procedures were illustrated in Chapter 9 by the token-train- 
ing method that Nickie used. 


Delivering Token Reinforcement 


Tokens should be delivered in a positive and conspicuous man- 
ner immediately following a desired response. Friendly smiling ap- 
proval should be administered at the same time the token is given, 
and the client should be told (at least in the initial stages) why she is 


receiving the token. 


The Reinforcing Agent 


It is generally agreed that the role of administering reinforce- 
ment should gradually be shifted from outside help to the clients 
themselves. The ultimate extension of this principle would seem to 
be that each client would become his own reinforcing agent, his own 
controller of his behavior. (Methods for developing self-control are 
discussed in Chapter 25.) In the meantime, other agents must be 
given the task of administering reinforcers. Ayllon and Azrin recom- 
mend that in situations where several managers dispense tokens to 
several clients (such as on a hospital ward), only one person should 
be assigned to reinforce a particular response at a particular time. 
Otherwise, "no one individual can be held responsible for failure to 
administer the reinforcement procedure properly, since any devia- 
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tion, omission, or modification is easily attributed to the behavior of 
some other employee" (Ayllon and Azrin, 1968b, p. 136). 


Amount of Tokens to Pay 


Tokens should be paid frequently in the early stages of the to- 
ken economy. Stainback et al. (1973) recommend that twenty-five to 
seventy-five tokens per child is not excessive on the first day of a to- 
ken economy in a classroom. They recommend further that the num- 
ber be gradually decreased to fifteen to thirty per day. 

Ayllon and Azrin (1968) recommend that the amount of tokens 
paid to mental patients for performing a specific job should be based 
on the desirability of that job rather than on any subjective judgment 
of how difficult or how important it is. One of their highest paid jobs 
was that of giving tours to visitors to the institution, because rela- 
tively few patients were willing to sign up for this job. Another con- 
sideration is the therapeutic value of the beh 
may pay more than others if the behaviors to be strengthened by 
performing the job are of particular value to the clients. Yet another 
consideration is the amount of pay that would be given were the job 
to be performed by a regular employee. Recent court decisions have 
indicated that mental patients are not to be exploited as a cheap 
source of labor. It appears from these decisions, and from the ethical 
judgments on which they are based, that clients should be remuner- 


ated at the same rate that regular employees would be for per- 
forming the same duties.! 


avior: a particular job 


Managing the Store 


The time at which back-up reinforcers m 
"store time"—should be scheduled frequently at first and less 
frequently later on. For schoolchildren, Stainback et al (1973 ecam 
mend that store time be held once or twice per da for the j h three 
or four days, and then gradually decrea vi “ee 
held only once per week (Friday afterno 
token economy. At least initially, 
items that can be readily consumed 
ery member of the token economy 


ay be purchased — 


children at a time be permi 
mitted at the stor 

a €. All memb hould 
EO ers should, 
UE able to Observe other members receiving back-up rein- 
: C . To optimize the effectiveness of available back : rein- 
orcers, one should never schedule competing back 5 ids SAO 
m i cers 
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concurently. For example, a movie should never be held at the same 
time as store time. 

In general, the price of each back-up reinforcer should be 
directly related to its cost in money. Stainback et al. give a simple 
method for calculating the monetary worth of a token. First, one 
needs to know the amount of money available (M), the number of 
days the token economy is to be in effect (D), the number of children 
in the token economy (C), and the number of tokens each child is ex- 
pected to earn per day (T). Then, the amount of money each token 
should be worth (W) is given by this equation: : 


Besides their monetary cost, two other factors should be consid- 
ered in assigning token values to back-up reinforcers. One is supply 
and demand. That is, charge more for items whose demand exceeds 
the supply, and less for items whose supply exceeds the demand. 
This will help to maintain an adequate supply of effective reinforcers 
and promote optimal utilization of the reinforcing power of each 
back-up reinforcer. The other factor to consider is the therapeutic 
value of the back-up reinforcer. A client should be charged very little 
for a back-up reinforcer that is beneficial to him. This will help in- 
duce him to partake of the reinforcer. For example, a client may be 

admission to a party because of the 


charged only a few tokens for 
important social skills that participating in this event may help to de- 


velop. 


POSSIBLE PUNISHMENT CONTINGENCIES 


The use of tokens provides the possibility of using fines as punish- 
ment for inappropriate behavior. This type of punishment may be 
preferable, from an ethical point of view, to physical punishment and 
th all forms of punishment, it should be used spar- 
ingly and only for clearly defined behaviors. An appropriate goal to 
strive for is one in which the clients themselves manage their own 
punishment contingencies. One suggested approach to this goal is 
the issuing of tickets (similar to traffic tickets) for infractions of rules. 
The client receiving a ticket may then challenge the appropriateness 
of the fine by appealing it to the managers of the economy. As the 
token economy progresses, this "jury" would consist of more and 
more of the clients themselves. At a highly advanced stage of the 
bers themselves would participate in formulating 
nd the fines to be imposed for infractions 


time-out. As wi 


economy, the mem 
the rules of the economy a 


of the rules. 
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RECORDS 


If fines are used in a token economy, it may be necessary to add 
training contingencies that teach clients how to accept fines in a rela- 
tively nonemotional, nonaggressive manner. Such contingencies were 
described by Phillips, Phillips, Fixsen, and Wolf (1973) for their token 
economy with predelinquent youths. In that economy, the contin- 
gencies related to fines probably taught the youths an important so- 
cial skill: how to accept reprimands from law enforcers in society. 


Up-to-date record keeping is an essential aspect of a token economy. 
It should therefore be built into the procedure of the economy. 
Records should be kept on the following: 


1. Target behaviors: The target behaviors of each client, and the conditions 
under which they occur, should be objectively defined and recorded so 
that the effectiveness of the procedures for each client can be objectively 
assessed and modified if they are not producing satisfactory results. ; 

2. Token reinforcements: The tokens received by each clie à 
was reinforced, the time and location of each re 
of the individual administering each reinforce 
These data will permit an assessment of whe 
adequate reinforcement. 

3. Back-up reinforcement: Each item bought, the number of tokens paid for it, 
and the name of the client who purchased it should be recorded. The data 
will provide a basis for assessing whether each clie ‘ 
quate back-up reinforcement and for evalu 
ent back-up reinforcers for different client: 
the extent of the demand for each b 
supply can be maintained. 


nt, the behavior that 
inforcement, and the name 
ment should all be recorded. 
ther each client is receiving 


nt is receiving ade- 
ating the effectiveness of differ- 
s. Also, such data will indicate 
ack-up reinforcer, so that an adequate 


SUPERVISION OF STAFF 


ment for appropriate behavior 
be corrected if the token econ 
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Records of reinforcement transactions (see the previous section) 
are another means of ensuring that the staff members are employing 
appropriate reinforcement procedures. These records should therefore 
be evaluated frequently, and staff members should be given frequent 
feedback on the basis of these evaluations. 


PREPARING A MANUAL 


The final stage to complete before implementing the token economy 
is to prepare a manual or written set of rules describing exactly how 
the economy is to be run. This manual should explain in detail what 
behaviors are to be reinforced, how they are to be reinforced with to- 
kens and back-up reinforcers, the times at which reinforcement is to 
be available, what data are to be recorded, how and when they are 
to be recorded, and the responsibilities and duties of every staff 
member. Each rule should be logically justified by the goals of the to- 
ken economy. This ensures that the rule will be reasonable and ac- 
ceptable to clients and staff. Every staff member should be given a 
copy of the manual, or a clear and accurate version of those portions 
of it pertaining to his specific duties and responsibilities. If feasible, 
each client should be given a clear and accurate version of those por- 
tions of the manual pertaining to him. If the client is not able to read 
fluently, but can understand the spoken language, he should be 


given a clear explanation of those portions of the manual that are 


relevant to him. , 
The manual should include definite procedures for evaluating 


whether the rules are being adequately followed, and procedures for 
ensuring that they are. Methods for arbitrating disputes concerning 
the rules should be included in the manual, and the participation of 
clients in the arbitration procedures should be provided for to the 
greatest extent that is practical and consistent with the goals of the 
token economy. Effecting such client participation is a step toward 
developing the behaviors involved in individual initiative, self-gov- 
ernment, and other skills that are so highly prized in the natural en- 
vironment. Toward this end, it is desirable at some stage in the token 
economy to have the clients themselves participate in constructively 
revising old rules and designing new rules for running the economy. 
The rules should also be capable of modification when there is evi- 
dence that a change is desirable. However, sudden and drastic 
changes can generate undesirable emotional behavior in clients. 
Moreover, clients may become disinclined to follow the rules when 
they are changed frequently or arbitrarily. So that rule modifications 
he smoothest manner possible, it seems advisable to 
1 itself specify the basis on which it will be revised. 
g rule changes should be given to 


may occur in t 
have the manua 
Advance notification of impendin 
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seminated prior to being put into effect. 


Study Questions 
(for examination purposes) 


N 


9. 


10. 


11 


. List three considerations that might influence a de 


. Why do we recommend that all members p 


. Describe three different types of token-training procedures for three dif- 


ferent functioning levels of students— severely retarded individuals, a 
normal kindergarten class, and university students. 


. How should tokens be delivered? 
. What are some of the advantages and disadvantages of assigning only 


one person to reinforce a particular response at a particular time in a to- 
ken economy on an institutional ward? 


. Suppose that a teacher initiates a token economy and initially arranges 


for each child to earn up to five tokens per day. Is that likely to be a 
good token economy? Why or why not (based on your knowledge of be- 
havior modification principles)? 


á né signer of a token econ- 
omy in deciding how many tokens to pay for a particular behavior. 


. According to Stainback et al., how often should store time be held dur- 


ing the first few days of a token economy? How does this recommenda- 
tion of Stainback et al. compare with the store-time frequency utilized 
by Nickie in her token economy? (See Chapter 9.) i 

articipating in the token econ- 
omy be able to observe other members receiving back-up reinforcement? 
Let's suppose that a teacher has initiated a token e 
and has managed to get along for the first thre 
cause we are in hard times, the principal has allowed a total of five dol- 
lars for purchasing back-up reinforcers during the next month (twenty 
school days). There are twenty-two pupils in the class, and the teacher 
expects each of them to earn an average of fifteen tokens per day. Ac- 


cording to the Stainback et al. formula, how much should each token be 
worth? 


conomy in a classroom 
e or four weeks. But be- 


Besides the monetary cost of the reinforce 
factors that might be considered in assigning token values to back-up 
reinforcers. However, these factors might be somewhat contradictory in 
certain instances. Describe an example in which this would be true. 
Considering the disadvantages of punishment discussed in Chapter 12, 
what are two possible bad side effects of introducing a punishment con- 
tingency of token loss (or fines) in a token economy? 

For a token economy on a ward in an inst j 


tal patients, or juvenile delinquents), de 
ule of staff supervision 


TS, we mentioned two other 


itution (for the retarded, men- 
scribe a plausible VI/LH sched- 
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staff supervision? 


13. What should be included in a manual describing how the token economy 


is to be run? 


Stolz, Wienckowski, and Brown (1975 p. 1042), state: 


Usually when patients work on hospital jobs, they are compensated at a 
level far below the prevailing wage or even below the minimum legal 
wage. This practice of employing institutionalized persons to perform pro- 
ductive labor associated with the maintenance of the institution without 
normal compensation has been called "institutionalized peonage" (Bart- 
lett, 1964). The Wyatt decision [503 F. 2d 1305 (5 Cir., 1974)] specified jobs 
that may be performed by mentally handicapped patients and held that the 
patients must be compensated for that work at the prevailing minimum 
wage. Another recent case, Souder v. Brennan [367 F. Supp. 808 (D.D.C. 
1973) ], extended the principle of the minimum wage compensation to all 
institutionalized persons in nonfederal facilities for the mentally ill and 
mentally retarded. Although the minimum wage requirement might seem 
reasonable on the face of it, it could be a problem for many mental in- 
stitutions and institutions for the retarded that cannot afford even the min- 
imum wage. Under Wyatt, apparently the only types of work exempt from 
minimum wage coverage are therapeutic work unrelated to hospital func- 
tioning and tasks of a personal housekeeping nature (Wexler, 1973). 


The question is certainly a difficult one from an ethical point of 
view, in that one may have to weigh a patient's right to a minimum 
wage against his right to a treatment that could facilitate his recovery. 
Which right should take precedence? One point that is perhaps relevant 
to this issue is that in society at large, wages must normally cover such 
basic necessities as food and housing. The question thus arises as to 
whether mental patients and retarded people should not also be ex- 
pected to pay for these things if their earnings are at or above the level 
of the minimum wage. Of course, it should also be recognized that 
workers in society at large generally have some choice about where 
they live and what they eat. These and other considerations indicate 
that the problem of ensuring the rights of institutionalized people, in- 
cluding their right to effective behavioral programs, will not have an 


easy solution. 


Study Question on Notes 


Do you agree or disagree with recent court decisions concerning the 
amount of money mental patients should be paid for working on hospital 
jobs? Considering the major arguments and counterarguments, logically 


defend your position. 


2. Why would a VI/LH schedule be preferred to an FI/LH schedule for 


You've Started 
r TOKEN ECONOMY: 


This chapter describes some problems commonly encountered in run- 
ning a token economy, the problem of transferring control to the nat- 


ural environment, and some additional ethical considerations. 


TYPICAL PROBLEMS AND SOLUTIONS 
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solutions. 


Confusion 


During the first few days after their initiation, most token econ- 


omies probably resemble mass confusion. We do not know of any 
way to completely avoid thi 
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fusion. Within a few days, clients and staff should have adjusted 
fairly well to the routine of the token economy. If they have not, it 
may be necessary to redesign the system. 


Shortage of Staff 


It may be that there are not enough staff members available to 
manage an extensive token economy, and that it is not feasible to uti- 
lize the clients themselves as managers. For example, in an elemen- 
tary school classroom with one teacher and no available help, it sim- 
ply may not be feasible for that teacher to perform all the duties a 
token economy necessitates— such as counting specific behaviors and 
handing out tokens—and at the same time continuing his other 
teaching duties. Stainback et al. (1973) suggest that if it is not feasible 
to distribute at least twenty-five tokens per day to each child, then it 
is best not to attempt a token economy. However, if a teacher does 
not have the necessary time to follow Steinback et al.'s suggestion, 
she might consider a partial token economy, which deals only with a 
manageable number of behaviors in a manageable number of clients. 
If desirable, such a token economy could then be gradually extended 


to more clients and more behaviors. 


Attempts to Beat the System 


Initially, a number of clients will attempt to beat the system by 
demanding tokens they have not earned or by demanding back-up 
reinforcers for which they do not have enough tokens. After ensuring 
that the clients understand the rules of the token economy, the man- 
agers should then extinguish undesirable requests by ignoring them. 
If the extinction procedure is applied consistently, the behavior will, 


hopefully, soon subside. 


Unauthorized Acquisition of Tokens 


In many token systems, it is possible that clients will obtain to- 
kens without earning them. For example, tokens may be obtained 
from other clients by stealing, gambling, borrowing, selling goods, or 
favors. One solution to this problem is to individualize the tokens 
that each client is awarded, so that the tokens cannot be spent by 
anyone else. Tokens with different colors or other markings (in- 
cluding the client's name) may be used for this purpose. 

Token individualization adds extra work and inconvenience to 
managing a token economy. It is often wise, therefore, to wait until 
inappropriate token acquisition has proved to be a problem that can- 
not be handled adequately and more conveniently in other ways. 
Stealing may quickly drop to a negligible level: many clients, after 
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having lost a number of tokens, will learn to protect them. Or it may 
be sufficient simply to confiscate unauthorized tokens so that there is 
no advantage to be gained from them. The number of unauthorized 
tokens a client has acquired can be determined by comparing the 
record of the number of tokens he has earned with the record of the 
number he attempts to spend. 


Playing with Tokens 


Initially, children will play with their tokens and this will seem 
undesirable because of the distraction it produces. According to 
Stainback et al., this behavior usually disappears soon. It should be 
tolerated in the early stages of the program because it helps (presum- 
ably) to firmly establish the tokens as reinforcers (on the reasoning 
that the more physical stimulation a conditioned reinforcer provides, 
the more effectively it mediates the time— or "bridges the gap" — be- 
tween the reinforced behavior and the back-up reinforcer). Should 
the behavior continue in strength beyond the initial stages, however, 
it may be a good idea to eliminate it by introducing an appropriate 
token-storage system. 


Job-Selection Problems 


When a client can sign up for various jobs that earn tokens, she 
may select a job at which there is little chance that she will work con- 
scientiously. If the job is an important one that requires more than 
the normal amount of responsibility, and if it is difficult to get a sub- 
stitute, this problem could be of some concern. Ayllon and Azrin 
(1968b) solved the problem (or at least reduced its magnitude) by 
charging tokens for the opportunity to work at such jobs. This en- 
sured that patients had to have already demonstrated some degree of 
responsibility (by earning tokens in other Ways) prior to working at à 
job requiring more responsible behavior. 

Sometimes the demand to perform a particular job is greater 
than the number of positions available for that job. Again, one solu- 
tion to this problem is to charge tokens for the opportunity to per- 
form that job. A fixed price may be set for the job, but it is also pos- 
sible to hold an auction in which the job is given to the highest 
bidder. Of course, the Pay scale for jobs can also be adjusted accord- 
ing to supply and demand, as we pointed out above. 


Failure to Purchase Back-up Reinforcers 


m > particular back-up reinforcer may never be bought because 
€ chents are unable to save enough tokens for its purchase. The law 
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of supply and demand would seem to suggest that the price of such a 
reinforcer be reduced. The director of the economy may not, how- 
ever, be inclined to do this if the item's cash value is quite high. A 
satisfactory alternative might be to sell the item in pieces, which 
would be assembled as they are bought. Stainback et al. gave the ex- 
ample of a bicycle whose parts were bought piecemeal and assem- 
bled in a classroom over a lengthy period of time. By being able to 
save enough tokens for the parts but not for the whole bicycle, the 
student who did this provided an interesting example of "the sum of 
the parts being greater (in reinforcement value) than the whole." It is 
likely that she also learned a number of useful mechanical skills in 
the process. Another problem is that particular back-up reinforcers 
may not be purchased even though clients have ample tokens to buy 
them. One solution to this problem is reinforcer sampling, (see Chap- 
ter 4, note 1). 


Tendencies to Reinforce 
Nontherapeutic Activities 


A great hazard of powerful contingencies of reinforcement— 
such as those that exist in effective token economies—is that they 
may be used to generate and maintain behaviors that are not benefi- 
cial to the clients subjected to such contingencies.! For example, 
Stainback et al. pointed out the tendency of teachers to assign "busy- 
work” — nonproductive exercises whose sole purpose appears to be to 
keep pupils engaged at some sort of academic task—after the stu- 
dents in a token economy have thoroughly learned the material nor- 
mally assigned to their age group. Because students in a token econ- 
omy often learn their lessons so well and so quickly, it is frequently 
difficult to keep them productively occupied with academic work. 
Part of the solution to this problem, as Stainback et al. see it, is for 
teachers to recognize that nonacademic activities are also acceptable. 
Students who have satisfactorily learned their coursework should be 
permitted to engage in other activities, such as playing or reading for 
their own pleasure. 

Similarly, Ayllon and Azrin noted the tendency of staff mem- 
bers to want to keep mental patients working at jobs long after the 
jobs ceased to benefit the patients. Here, the tendency stemmed not 
from a desire to keep the patients busy, but rather from the fact that 
the patients were genuinely helping the staff members perform their 
duties. To offset this problem, Ayllon and Azrin instituted a job rota- 
tion rule: ^A patient should not be allowed to hold the same job 
without interruption for more than a week at a time." In this way, 
patients could learn a number of different skills and participate xis 
a greater variety of social interactions. The staff readily accepted this 
rule when its rationale was clearly explained to them beforehand. 
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TRANSFERRING BEHAVIOR TO THE 
NATURAL ENVIRONMENT 


Token economies are sometimes regarded as ways to manage prob- 
lem behavior in institutional settings. They do serve this function, 
but it would be unfortunate if this observation led us to neglect their 
more important function of helping clients adjust to the natural envi- 
ronment beyond the institution. Because social reinforcement, not to- 
kens, prevails in the natural environment, a token economy should 
be designed such that social reinforcement gradually replaces token 
reinforcement.” There appear to be two general ways of fading to- 
kens. One is to gradually eliminate them. The second is to gradually 
decrease their value. The first alternative can be accomplished by 
gradually making the schedule of token delivery more and more in- 
termittent, by gradually decreasing the number of behaviors that earn 
tokens, or by gradually increasing the delay between the target be- 
havior and token delivery. The second alternative can be accom- 
plished by gradually decreasing the amount of back-up reinforcement 
that a given number of tokens can purchase, or by gradually increas- 
ing the delay between token acquisition and the purchase of back-up 


reinforcers. At present, we cannot say which method or combination 
of methods produces the best results. In addition 


erations involved in programming generalization ( 
ter 11) should be reviewed. 

Gradually transferring control to the clients themselves so that 
they plan and administer their own reinforcements is another step in 
preparing clients for the natural environment, An individual who can 
evaluate his own behavior, rationally decide what changes need to be 
made in it, and effectively program for these penny cle 
good position to cope with almost any environment m which he 


finds hi If. Method ishi i } 
Chapter 35, ethods for establishing these skills are discussed in 


, all of the consid- 
discussed in Chap- 


arly in a 


ETHICAL CONSIDERATIONS 


Token economies involve the systematic application of behavi 

modification techniques on a relatively large scale, Th OLDE avior 
of abusing the techniques, even unintentionall ài ^ porcum 
fied. Precautions should be taken to avoid Mere re thereby magni- 
caution is to make the system completely open ceu yet 
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Visits by outsiders, including newspaper reporters and other repre- 
sentatives of the media, should be encouraged. Visitors should be al- 
lowed free access to the manual of rules governing the token econ- 
omy. Their questions and criticisms should be answered satisfactorily 
by the administrators of the economy. Visitors should be also per- 
mitted to talk to the clients of the economy and obtain their impres- 
sions of it. Ayllon and Azrin even adopted the commendable policy 
of giving visitors tours conducted by the clients themselves. An 
open-door policy of this sort will help not only to ensure high ethical 
standards, but also to allay the fears and suspicions about behavior 
modification that too often exist in the minds of the public in general 
and the relatives of the clients in particular. 

Another precaution is to clearly inform the clients of their legal 
and moral rights. Furthermore, clients and managers should be in- 
structed to report any infringements of those rights. Such reports, as 
well as other complaints and criticisms, should be listened to and 
quickly acted upon in a morally responsible fashion. 

The ends of a token economy and the suitability to those ends 
of the means for obtaining them constitute the "acid test" of the eth- 
ics of the token economy. Thus, the ethics of a token economy will 
ultimately be judged on the basis of how effectively and humanely 
the transfer to the natural environment is carried out. (For additional 
discussion of ethical issues concerned with behavior modification, 


see Chapter 29.) 


Study Questions 


(for examination purposes) 


1. The problem of confusion during the first few days of a token economy 
might be viewed as a behavior modification problem. Outline the steps 
that you might take (in a general sense) to solve this problem. 

2. Discuss how shortage of staff to manage a token economy can be han- 
dled. 

3. Suppose that the attempts to beat the system by one particular student in 
a token economy do not seem to extinguish. Suppose that you have de- 
cided that this is a behavioral problem that must be solved. Briefly out- 
line the "shortcut" strategies that you might follow to eliminate this be- 
havior (see Chapter 16). 

4. How did Nickie handle the problem of children playing with the tokens? 
(See Chapter 9, p. 135) What do Stainback et al. recommend concerning 


this, and why? 
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5. Allowing clients to select jobs at which they would like to work, or per- 
haps requiring them to pay some of their hard-earned tokens for the op- 
portunity to perform certain jobs (and hence earn even more tokens) is a 
plausible approach for highly verbal patients. True or False? Discuss. 


6. What is a possible solution for the management of very expensive items 


for which the clients seem unable to save enough tokens to purchase? 


Give an example. 


7. Ayllon and Azrin instituted a job-rotation procedure to ensure that men- 


10. 


force a behavior may impede the generalization of t 


tal patients would not be kept at jobs long after the jobs ceased to bene- 
fit the patients. Outline a rule, or set of rules, that teachers might follow 
to ensure that students are not kept doing “busywork” or classroom ex- 
ercises long after the exercises have benefited the students. 

What are the two general methods of fading tokens when transferring 
behavior to the natural environment? Explain the different ways these 


methods can be carried out. 


If one decides to gradually de 
tokens, what general guidelines might be 
behaviors no longer require token reinforcement? That is, w 
start, and which behaviors do you start on? 

What precautions should you take to help ensure high ethical standards 


for your token economy? 


crease the number of behaviors that earn 
followed in deciding which 
here do you 


Holland (1974, p. 201) expressed this concern as follows: 


many ... instances follows an elitist system, 
and, at least as a secondary effect, seems to legitimize that form. More- 
over, while | know those conducting such token economies on hospital 
wards and in prisons, etc. will take issue with me, the decisions as to what 
behaviors should be reinforced very often seem to depend upon the crea- 
tion of the kind of ward behavior pleasing to hospital personnel—to “Big 
Nurse” for those fans of Kesey's novel, One Flew Over the Cuckoo's Nest. 
| will admit here some of my own ambiguity and uncertainty. Well-made 
beds, well-groomed patients, patients sweeping the floor and keeping neat 
may be valuable behaviors to the patients themselves, but it is clear they 
reflect most definitely what Big Nurse desires. It is questionable whether 
nurses who walk around handing out tokens do much to establish per- 


sonal self-esteem in the patient. 


Speaking in a'similar vein, Krasner (1976, p. 635) stated: 

onomies continued by developing a pro- 
gram involving systematic economic planning in a state hospital (Winkler 
& Krasner, 1971). One observation that Winkler and | made was that to the 
extent that we were successful in developing a token economy program 
on a hospital ward, we were helping maintain a social institution, the men- 
tal hospital, that in its current form, was no longer desirable in our 
society. We decided that based on our own value system, we would not 
develop further token economy programs in mental hospitals. 


The token economy in ... 


My own experience with token ec 


of tokens to rein- 


Levine and Fasnacht (1974) argued that the use 
hat behavior to the 


(Continued) 
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natural environment. Their argument is based mainly on the results of 
experiments purporting to show that "extrinsic" reward for performing 
a task tends to undermine "intrinsic" interest in the task. In these ex- 
periments, college students or children were given money or prizes for 
solving puzzles, drawing, or playing a game. A control group of com- 
parable individuals was instructed to engage in the same activities, but 
was not rewarded for doing so. Following this, when both groups were 
given the opportunity to engage in the specified activities without being 
rewarded, it was found that on the average those individuals who had 
previously been rewarded spent less time engaging in the activities (and 
also ranked them as being less enjoyable) than those individuals who 
had not previously been rewarded. 

These experiments, however, do not seem to be very relevant to 
the way in which competent behavior modifiers use tokens. For one 
thing, as two critics of Levine and Fasnacht’s article (Bornstein and 
Hamilton, 1975) pointed out, behavior modifiers do not typically make 
tokens contingent upon desirable behaviors that already occur at a high 
rate. Moreover, as two other critics (Reiss and Sushinsky, 1975) pointed 
out, the results can very likely be explained in terms of behavioral pro- 
cesses that should not be a serious obstacle in programming general- - 
ization from a token economy to the natural environment. Specifically, 
it is known that if a period of high reinforcement precedes a period of 
low reinforcement, responding during the period of low reinforcement 
will tend to be less than it would have been if the period of high rein- 
forcement had not occurred. However, this effect—which appears to be 
related to the behavioral-contrast effect described in note 1 of Chapter 
42—is quite temporary. As the period of low reinforcement continues, 
responding soon returns to the level it would have been at if the period 
of high reinforcement had not occurred. Thus, if a token economy IS 
designed appropriately, such that social reinforcement gradually re- 
places token reinforcement, the social reinforcement should then be at 
least as effective as it would have been if tokens had not been used. 

A third consideration is that there is inconsistent evidence con- 
cerning intrinsic and extrinsic reinforcement (see the discussion of the 
Feingold and Mahoney study in note 4 of Chapter 3). 


Study Questions on Notes 


1. Briefly discuss why it might not be ethical to establish token econo- 
mies in mental hospitals. Briefly discuss possible ways in which these 
ethical problems might be solved. ; 
2. Discuss whether using tokens to reinforce behavior can impede the 
generalization of that behavior to the natural environment. 


CHAPTER 25 
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Helping an Individual 
to Acquire 


SELF CONTROL 


"If you had more will power, you could get rid of that bad habit.” “If 
you had more will power you could improve yourself and get some 
better habits." If you are like most People, you have probably heard 
such advice many times. It is also likely that you have seldom appre- 
ciated it. And for good reason: it is usually not very helpful advice 
because the person offering it almost always neglects to tell you how 
you can get more of this so-called will power. 

Behavior, as this book has constantl 
by the environment—not by inner forces such as "will power." So 
your bad habits exist, not because you lack will power, but because 
they are supported by “bad” contingencies of rei 
environment. Likewise, your good habits are not 


y emphasized, is controlled 
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a treatment program based on behavior principles, evaluating the ef- 
fectiveness of the program, and appropriately changing the program 
if the data show that it is not producing satisfactory results. Self-con- 
trol procedures differ from other procedures, however, in that the 
client assumes the major responsibility for carrying out the program, 
including arranging his own contingencies of reinforcement. This 
presents certain difficulties that are unique to self-control programs. 
The most troublesome of these difficulties is called short-circuiting of 
contingencies. This process can be easily seen in two simple examples: 

1. Suppose you want to study more efficiently because this be- 
havior will eventually bring you a great deal of reinforcement—such 
as getting the kind of job you want, being able to talk intelligently 
with other people, and understanding events in the world around 
you. But this reinforcement is far in the future. It is therefore very 
difficult for it to compete with the weaker but more immediate rein- 
forcement of even a moderately entertaining TV program. It might 
seem logical to use your TV watching to reinforce your studying be- 
havior. On the other hand, studying does not turn on the TV; flicking 
the switch on the TV set does. There is a good chance, therefore, that 
the reinforcement contingency will be short-circuited, in the sense 
that the reinforcer will be consumed without the desired behavior 
having occurred, as illustrated in Figure 25-1, pg. 377. 

2. Suppose that you want to decrease your food intake because 
you know overeating can cause health problems and make you less 
attractive physically to other people. But these punishers are long de- 
layed. Therefore, they have a hard time competing with the reinforce- 
ment residing in that piece of pie sitting in front of you. You might 
decide to bring some more immediate punishment to bear on the 
problem by pinching yourself each time you take a bite of pie. But, 
the pain that you feel punishes the skin squeezing (pinching) as 
much as it punishes pie eating. There is a good chance, therefore, 
that the punishment contingency will be short-circuited, in the sense 
that the undesirable behavior will occur and the punisher will not 
follow it. The pinching disappears while you, feeling perhaps only a 
little guilty, continue to enjoy the pie. 

Despite the problem of short-circuiting, research indicates that 
self-control can be developed. This is fortunate for people with very 
severe behavioral handicaps, because it means that many of them can 
progressively assume greater responsibility for their own behavior, 
and thereby lead more normal lives. It is also fortunate for those who 
are already behaviorally well developed (such as the "average" per- 
son), because they can learn to manage their own behavior problems 
without having to depend on others to do it for them. 

The difficulties and advantages of self-control procedures rela- 
tive to procedures considered previously in this book can be clarified 
if we discuss them under five general headings: identifying the prob- 
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IDENTIFYING THE PROBLEM 


Unlike most of the cases considered previously in this book, the can- 
didate for a self-control program realizes that he has a problem and 
has probably attempted to solve it himself. Failing in that effort, he 
has, let us assume, come to a behavior modifier or behavior therapist 
for help. The therapist does not attempt to solve the problem directly, 
but acts more as a consultant, providing the client with the proce- 
dures he must undertake in order to solve his problem.? At each 
step in the treatment, the therapist should not just give advice; she 
should also clearly explain to the client the reasons for that advice, 
and should proceed only with the client’s informed consent. This is 
desirable (1) because of the consultant-client nature of their relation- 
ship, (2) because the client might carry out the procedures more accu- 
rately if he understands and accepts their rational, and (3) because 
this approach should help the client learn how to solve other behav- 
ior problems he may encounter. 

The therapist helps the client to define the problem in behav- 
ioral terms, shows him how to take data on the problem, recom- 
mends a treatment program, and helps the client evaluate the out- 
come of the program. In this section, we will concentrate on defining 
the problem and data collection. 

The first step is to define the problem behaviorally. This may 
require one or more very intensive interviews, The client himself 
may not have a clear idea of what the problem is. Or he may be 
ashamed to acknowledge the problem and start out by describing a 
trivial or nonexistent problem. The therapist must therefore take 
pains to assure the client that he is not judging him. All behavior is 
ish SOS esempi E LN 
These laws cannot be changed, but the dien een. ee 

; : : disp lent can use them to change 
his own behavior. Quite often, it is useful to help the client fill out a 
ares amet est i prc helps the client relax an 

t y be useful in program design. A 
sample of such a sheet is shown in Figure 25-1. 
Gradually, the client will begin to talk more 


what is really bothering him. Specification of the problem can then 
begin. This is usually not too difficult if the problem invol a be- 
havior that is easily observed and measured, such a cim 
ing. On the other hand 
behaviors involved in 


and more about 


i ed, s excessive smok- 
; it may be very difficult to pinpoint the exact 
a problem such as depression or anxiety. An 
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FIGURE 25-1. A factual-information sheet (containing questions for a ther- 
apist to ask of a client)." 


Client’s name . = — —— A Married or single 
Address ~~~ Date of last medical exam 
Telephone (home) — (work) — Physical handicaps? 

Age = S 


Did someone refer you to me? 


If no, why me and not someone else? 


- Female 


he — —— — Male — Ages 

Do they live at home? — ~~~ 

Occupation of client ee 

Occupation of-spouse——— — —— — 

How long have you been in current location? 1. 
and before here? _— T EM — 

Any relatives here? ——d— —— Er ru M 
elsewhere? ee ee 

Hobbies or involvement other than work? 
How often? err m E Se rn SS a a E IR m 

Is anyone else in the family interested in your well-being? —— 

Are any friends interested in your well-being? = ———___________ 

What are your favorite pastimes? M d ve E Ce 


What is the best time of the day for you, and why? In mna e 


What is the worst time of the day for you, and why? . ; A lec 


In your own words, why are you here? — —= —— —— ——— ——— 


*This information sheet was described in an unpublished paper by Lyle Wray and Larry Williams. 
University of Manitoba. 1975 


approach used by Schwartz and Goldiamond (1975) is to tell the 
client to imagine that Martians have landed on earth and are doing 
an observational study of its inhabitants. One of these Martians has 
been assigned to observe the client. Now these Martians, of course, 
know nothing about human feelings. They can observe only behav- 
ior. The client, having imagined this, is then asked, What will your 
Martian observe now, when you are still suffering from your prob- 
lem, and what will he observe later, when the problem has been 
solved? By this or some similar means, the client is induced to spec- 
ify both the problem and the treatment goal in behavioral terms. For 
example, a depressed person might say that his Martian would see 
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him sitting alone in his room staring at the walls a great deal before 
treatment, and spending more time reading novels and interacting 
with other people after treatment. If it is difficult for you to encour- 
age the client to clearly identify the problem, you might prepare a 
specific set of questions designed to identify the problem and its 
controlling variables. For example, the questions in Figure 25-2 are 
designed to help identify the details when the problem is to get rid 
of an undesirable behavior that is currently occurring. 


FIGURE 25-2. Some questions to ask a client in order to help identify a 
problem and its controlling variables 


SPECIFYING THE PROBLEM 


1. In your own words, could you describe what your problem seems to 
be? 

2. Could you write out at least three examples of everyday situations in 
which this behavior occurs or does not occur. 

3. Are there other behaviors that you engage in that seem to be related to 
the problem behavior? E.g., if your problem is extreme nervousness when 
asking for dates, do you bite your nails and stammer at the same time? 

4. Do you have any emotional reactions when your problem behavior is 
occurring? E.g., does you heart beat faster? Do you feel weak? Angry? 
Frustrated? Try to state any emotional reactions in terms of the behav- 
iors involved. E.g., if you feel angry, you may feel your palms sweating 
and your heart beating faster. 

5. Can you state the problem in positive terms? E.g., if the problem be- 
havior is nail biting when studying then rather than saying "| want to 
stop nail biting when | study," you could say “I want to keep my hands 
clasped on the desk or at my sides when | am studying." 

6. Now that your behavior is positively stated ("1 want to engage in a par- 
ticular behavior in a particular situation"), could you specify a chain of 
events that could possibly lead to the accomplishment of that behav- 
ior? E.g., “I go to the study area. | sit at my desk. | get all my material 
ready (open books, take out pen, etc.). I clasp my hands on the desk 
and separate them only to turn pages or to write." 

7. Now that you have had time to think about your problem behavior, 
could you be more precise in specifying your problem in terms of the 
actual behaviors that are occurring? E.g., feeling Sorry for yourself 
might be broken down into thinking about a girl who turned you down 
for a date, talking to a specific friend about how "broke" you are, and 


looking in store windows at all the things you would like but can't af- 
ford. 


8. How often does the problem behavior occur? 


WHEN DOES THE BEHAVIOR OCCUR? 
1. When does your problem behavior typically occur? E.g., what time of 
day? What day of the week? What time of the month? 
2. What other activities are you typically engaging in when your problem 
behavior does or does not occur? Can you be exact? 
3. Can you specify at least three recent situations when your problem be- 


havior typically would have occurred but did not? What behavior were 
you engaging in at this time? 


FIGURE 25-2 (continued) 


WHERE DOES THE BEHAVIOR OCCUR? 


1. Where does your problem behavior occur? Try to specify at least five 
typical situations. E.g., at home? (Any particular room?) At work (At 
your desk? In someone else's office?) In your car? At social events? 

2. Do you engage in the behavior by yourself? With one person? In 
groups? If others are present, what type of people are they? Family? 
Friends? Acquaintances? Enemies? etc. 

3. In which situations does your problem behavior not occur? E.g., what 
are the physical surroundings? What people are present? 

4. Why do you think you do not engage in the behavior in the situations 
you mentioned in Question 3? That is, what alternative behavior are 
you engaging in that is preventing you from engaging in your problem 
behavior? 


WHAT ARE THE TYPICAL CONSEQUENCES OF THE BEHAVIOR? 


Does the behavior change the environment? In what way? 

Is there another behavior you always emit just before or after the 
problem behavior? 

Is what happens after the behavior due only to the behavior? 

Do you emit the behavior to cause something you like? 

Do you emit the behavior to prevent something you don't like? 

Is the consequence a physiological event—that is a sense or a feeling? 
Is the consequence a social event—that is, other people's behavior? 
Does someone else you know emit this behavior? 

Do people "hassle" you for emitting this behavior? 

Do people encourage or condone your behavior? 


ma 
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The client may have more than one problem. Or what he per- 
ceives as one problem may be easier to deal with if it is subdivided 
into several smaller problems. In such cases, the therapist should 
treat only one of these problems or at most a few of them. Priority 
should, of course, be given to problems that appear to be truly ur- 
gent. Otherwise, the easier problems should be dealt with as soon as 
possible because the quick resolution of one or two problems will re- 
inforce the client's efforts to control his own behavior. 


BASELINING THE PROBLEM 
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Having reached a tentative decision on the problem behavior, the 
therapist will encourage the client to take data on the occurrence of 
the problem —for instance, when, where, and how often it occurs. 
There are a number of techniques that the therapist might recom- 
mend for increasing the strength of record keeping. For example, if 
the problem behavior is smoking, the client should be instructed to 
record each cigarette before it is smoked, so that the behavior will re- 
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inforce recording it. The client might set up external reinforcers that 
are controlled by other people. For example, he may give control of 
his spending money to someone (for example, his spouse) who can 
monitor his behavior continuously for extended periods of time and 
who could return his money contingent upon his consistent data tak- 
ing. The client might also get other people to reinforce his recording 
behavior by (1) telling his friends about his self-modification project; 
(2) keeping his recording chart or graph in an obvious place in order 
to increase the likelihood of feedback from friends; and (3) keeping 
his friends informed on how the project and results are progressing. 
Contingencies mediated by other people are an important safeguard 
against the short-circuiting processes described at the beginning of 
this chapter. 

The client should also streamline the recording system so that 
the behavior counted is as simple as possible and the data sheets are 
portable and appropriate to all situations in which the behavior oc- 
curs. Additionally, the recording chart or graph should be designed 
so that behavior improvements will be conspicuous. If the client is 
using graph paper and wants to plot the number of cigarettes 
smoked per day, he should have a scale that will use all of the verti- 
cal axis rather than just half of it. Finally, the client should be encour- 
aged to provide S"s for recording. For example, if he is to record his 
weight each morning, he might post his weight chart on the mirror 
he uses for shaving. 

The therapist meets with the client Periodically (for instance 
one hour per week) and goes over the data with him Reine the 
treatment procedure is initiated, the data provide a baseline in- 
dicating the magnitude of the problem and its controlling adco 
Both types of information help to define the problem da Ai $ : ins 
dicate whether it is really serious enough to merit RENE i Se Br 
times, simply recording the behavior results in its ing rov a pad 
pp. 273-6.) If the problem does not require RE the the ra is 
should so advise the client. The preliminary data als foede PRA 

hat treatment procedure, if vh elu indicata 
w à procedure, if any, should be used. After treatment be- 
gins, the client continues to take data for the purpose n qu 
the effectiveness of the treatment (the reasons ke akin po p. 
cussed in Chapter 18 apply equally well to the area of z He A is- 

Usually, during the problem-defining and b elf-control) 
therapist determines whether other people besides the cli t 
nificantly involved in the problem (these people are ref c n: are sig- 
nificant others). For example, frequent arguing wae ct to as sig- 
directly involves more than one person contributing to w c in- 
from the problem. Even a problem that seems at first "" > rou 
only one victim probably involves other people directl 8 i to ns 
a wife may wish to help her husband give up PAM E e jai et 
is concerned about his health and because she is Serene a pH 


aseline stages the 
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effect the smoke is having on the health of the rest of the family. It is 
usually desirable to involve significant others in a client's treatment 
if— but only if—they are willing to be involved. If they are not willing 
to cooperate in the treatment, the therapist treats the problem as 
being the client's. This makes good ethical sense, because if the sig- 
nificant others have not chosen to be the therapist's clients, she has 
no business trying to treat them. It also makes good practical sense 
because of the danger inherent in basing a program on cooperation 
that is not likely to be available. 

However, during the treatment a client's changed behavior may 
indirectly change the behavior of significant others, even though they 
themselves have not contracted for treatment. Consider the following 
hypothetical case. A woman comes to a behavior modifier for treat- 
ment of what she calls "depression." The initial interview and base- 
line data indicate that the depression stems from (or is perhaps a la- 
bel for) overwork and insufficient reinforcement. Her two adult sons, 
both living at home, refuse to do any household chores. Instead, they 
expect her to do all of the work, including cleaning up after them. 
Moreover, they will not consider participating in a treatment pro- 
gram. Analysis of the preliminary data indicates that the problem is 
due, at least in part, to the client being unable to refuse excessive de- 
mands on her time and labor. If the client agrees with this assess- 
ment, a self-control program might then be initiated whereby the 
client learns to be more assertive when her sons make demands. This 
might lead, indirectly, to her withholding reinforcement for excessive 
demands and reinforcing more desirable forms of behavior by her 
sons. If the program is successful, it might result in a desirable 
change in their behavior, even though they are not directly involved 
in the program. 

During the baseline, the client should be taught to take a close 
look at the situations that exist just before the undesirable behavior 
occurs, as well as the consequences of undesirable behavior. From 
this simple exercise generally comes suggestions for successful pro- 
gramming strategies. For example, a problem frequently reported by 
the university students is that they get tired fairly quickly when they 
are studying at home.* Such students usually report a typical pattern. 
The student sits down wherever she studies and begins reading or 
working at the material. After a certain period of time, she begins to 
feel drowsy and decides to take a break. The break usually consists of 
making a cup of coffee and something to eat, watching a few minutes 
of TV, or phoning a friend. After the break (which is sometimes very 
extended), the student returns to work. But after a relatively short pe- 
riod of time, she again becomes drowsy and the pattern repeats itself. 
Now let's examine the situation. What are the immediate positive 


*This discussion is based on a paper by Martin (1975*,) and is closely paraphrased by 
permission of the publisher 
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consequences of the initial desirable behavior of working in an alert 
fashion? None. Rather, the individual simply continues working until 
she starts to feel drowsy. On the other hand, what are the con- 
sequences of the individual feeling drowsy? Obviously, a very rein- 
forcing break period. In other words, the student is following the 
worst possible course of action. Feeling drowsy in a study situation 
is being highly reinforced by taking a break, whereas working effec- 
tively does not lead to immediate reinforcing consequences. Once re- 
alized, an effective strategy for the individual is to take a break ear- 
lier than usual. If a student can study normally for fifteen minutes 
without feeling drowsy, then at about the thirteen-minute mark, 
while still working effectively, she should take a brief break. Over a pe- 
riod of time, the duration of the effective studying (rather than feel- 
ing drowsy) is increased in the presence of the cues appropriate to 
proper study behavior. In general, then, while taking a baseline the 
individual should be on the alert for immediate consequences that 
might be maintaining the undesirable behavior to be eliminated, as 
well as the immediate consequences (or lack of them) 
that the individual wishes to develop. 


of the behavior 


DESIGNING THE SELF-MODIFICATION PROGRAM 


The therapist next helps the client to desi 
Sometimes a program will consist of a simple rearrangement of par- 
ticular consequences of specific behaviors, as in the example of man- 
aging fatigue and increasing alertness while studying. Another ex- 
ample of rearranging consequences was reported by a Canadian 
"Mountie," whom we'll call George, who wanted to quit smoking. 
His girlfriend, Sally, while taking a course from one of the authors, 
had noted that in addition to the smoke itself other reinforcers were 
usually associated with smoking. For exam 
having coffee, while drinking beer in t 
friends, and while talking on the phon 
prompts from Sally, George decided that h 


gn the self-control program. 


ple, George smoked while 
he pub, while talking to 


ght or gradually cut down), but 
, if he was in the 
d have one, but he had to go to 
until he had finished smoking. 
a Cigarette, he had to stop at à 
oom for a smoke. Within two 


house and wanted a cigarette he coul 


service station and go into the bathr 
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weeks, smoking became quite disinteresting for George. Sitting on 
the "throne" and having a cigarette just isn't that much of a “thrill.” 
By the end of the second week, his cigarette smoking had dropped to 
a very low level (from a baseline of approximately a package a day). 
Even the few that he smoked usually involved only a few puffs each, 
since after a couple of puffs in the bathroom he would simply throw 
the cigarette in the toilet and leave. By the end of the first month, 
George had ceased smoking, his urges were few and far between, 
and the urges he did experience were controlled. A follow-up one 
year later indicated that George was still not smoking. 

If simply rearranging existing reinforcers is not adequate, it may 
be possible to solve the problem by introducing some new rein- 
forcers for desirable behavior. Consider a recent self-modification 
program initiated by one of the authors. During the winter, he began 
an exercise program that involved running two miles three times per 
week at the underground track at the University of Manitoba. A two- 
mile run on the track is fourteen laps. The author found that after 
nine or ten laps, he began to think a lot of fatigue thoughts and 
would frequently talk himself out of doing the last few laps, saying 
things such as "Oh well, I’ve done pretty good by running eleven 
laps,” or “Gee, my legs are tired; I guess I'm not in good shape yet." 
He decided that as a behavioral psychologist, he should be able to cure 
the problem. He therefore planned that during each of the tenth 
through the fourteen laps he would think some antifatigue thoughts 
and then allow himself some reinforcement. The particular antifatigue 
thought that he chose was about a TV physical fitness commercial 
claiming that the "average sixty-year-old Swede is in the same physi- 
cal condition as the average thirty-year-old Canadian." (We have 
since learned that the claim is false, but this is not important to our 
illustration.) Thus, he would think this thought and imagine the 
commerical showing the extremely healthy sixty-year-old Swede jog- 
ging along through the bushes and looking trim and full of vim and 
vigor. The author picked a particular spot at one end of the track, and 
each time he got to that spot he would force himself to think the par- 
ticular antifatigue thought about the very healthy Swede jogging 
merrily along. When he reached the next corner of the track, he 
would then think a highly reinforcing thought, which varied some- 
what from day to day and included such things as making love with 
his wife (or perhaps fantasizing about someone else) and watching his 
son play hockey. He allowed himself to think the reinforcing thought 
across the end of the track, and then would simply not think either 
the Swede thought or the reinforcing thought down the other side of 
the track. In this way, he was able to engage in a private behavior 
that counteracted the fatigue thoughts and was also able to reinforce 
that behavior. After practicing this determinedly for about two 
weeks, he was able to put the fatigue thoughts completely "out of 


mind." ? 
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Many everyday activities that people take for granted are poten- 
tial reinforcers in a self-management project. Activities that have 
been used as reinforcers include closing drawers, rising and sitting at 
a desk, entering buildings, answering a telephone, sipping coffee, 
puffing on a cigar or cigarette, sitting in a favorite chair, turning ona 
faucet, and urinating. Watson and Tharp (1972) provide detailed 
methods and examples of using such reinforcing events in self-man- 
agement projects. 

So far, we have considered only very simple examples of self- 
management. Some problems, however, require a step-by-step self- 
modification project that may last several months or more. Such cases 
may involve a therapist providing instructions, some modeling, and 
an opportunity for behavioral rehearsal and role playing by the 
client. Recall the example in Chapter 15 in which the therapist uti- 
lized instructions, modeling, shaping, and role playing to help a col- 
lege student learn how to ask for a date over the telephone. In other 
cases, a therapist might interact extensively with a client in order to 
help him develop self-control over his self-verbalizations regarding 
his behavior and its causes. Cognitive psychologists generally de- 
scribe this approach (which we discuss in more detail in Chapter 27) 
as helping an individual to change his behavior by helping him to 
change his beliefs or thoughts about his behavior. In some cases, 
therapists helping clients in complex self-control programs might go 
through all the steps in the guidelines in Chapter 21, especially those 
cited in the section entitled "Strategies of Program Design and Imple- 
mentation.” 


CONTRACTING: A WAY TO ENSURE 
MANAGEMENT OF THE PROBLEM 


As mentioned earlier, contingencies mediated by other people help to 
counteract short-circuiting. It is largely for this reason that, before the 
initiation of a self-control program, the therapist may encourage the 
client to prepare a behavioral contract. Such a contract is simply a 
very clear statement of what behaviors of what individuals will pro- 
duce what reinforcers, and who will deliver those reinforcers. Some 
authors have described behavioral contracting as scheduling the ex- 
change of reinforcers between two or more individuals (DeRisi and 
Butz, 1975; Sundel and Sundel, 1975). The majority of published work 
on contracting involves two or more individuals and has been con- 
cerned primarily with family interactions, such as between parents 
and children, and between husbands and wives. However, a on 
need not necessarily involve others: an individual mi : 
"self-contract'' (see Watson and Tharp, 1972). 
When helping a client to develop self-control 

would likely encourage her to prepare a contract 
gram that would include: 


ght prepare a 


the therapist 
of the proposed pro- 
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3. reinforcers to be used, their schedule of delivery, and who will deliver 
them; 


4. potential problems and their resolution; 
5. bonus and/or penalty clauses; 

6. a schedule of review for progress; 

7. signatures of all involved, and the dates of the agreement. 


The contract serves at least four important S? functions: 


1. It ensures that all parties involved agree to the goals and procedures, and 

that they do not lose sight of them during the course of the treatment. 

Because the goals are specified behaviorally, the contract also ensures that 

throughout the program all parties will agree on how close they are to 

reaching the goals. 

3. The contract provides the client with a realistic estimate of the cost of the 
program to him in time, effort, and money. 

4. The signatures on the contract help ensure that all parties will faithfully 
follow the specified procedures, because in our society signing a docu- 
ment is a strong S" indicating a commitment. 


N 


FIRST I'LL MOW THE 
LAWN, THEN I'LL 

REINFORCE MYSELF WITH 
BEER AND POTATO CHIPS, 


MAYBE I'LL MOW THE 
LAWN LATER. 


| 


|y bil 
"— 


FIGURE 25-3. An example of short-circuiting 
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As we have stressed in previous chapters, behavior modification 
procedures should be revised in appropriate ways when the data in- 
dicate that they are not producing satisfactory results. Thus, the con- 
tract should be open to renegotiation at any time. If, for example, a 
signatory finds that she simply cannot meet some commitment speci- 
fied in the contract, she should so inform the other signatories at the 
next meeting with the therapist. The difficulty would then be dis- 
cussed, and, if it seemed desirable, a new contract replacing the pre- 
vious one would be negotiated, drafted, and signed. 

The following contract was prepared by a student in a course on 
behavior modification and self-control taught by one of the authors. 
This student worked in a mental-retardation institution, where she 
had experienced considerable difficulty because of her tendency to 
become upset with other staff members. After preparing a baseline of 
the problem behaviors, the student prepared and followed the pro- 
gram described in this contract. 


SAMPLE CONTRACT 


A. Problem and Goal 


Achieving a frequency of zero instances per day of anger in response 
to hearing someone lying or being dishonest or in response to remember- 
ing an instance of someone lying or being dishonest. 


Definitions: 


Anger: muscle tension, particularly in the hands and face, in re- 
sponse to hearing someone lie. 
One instance: an uninterrupted episode of anger— that is, an episode not 


interrupted by thinking about Something else that did not 
cause anger. 


Lying: any verbal statement, verbal omission. or shake or nod 
of the head that | consider to be a lie. Note: Whether or 


not the other person is lying is based on my own feeling 
that it is a lie. 


B. Data Collection 


Each instance of anger is recorded as one count on a wrist counter 


(golf scorer) that | am to wear. These instances will be graphed each eve- 
ning before | go to bed. 


C. Reinforcers and Their Delivery 


1. Daily: if the target for that day, as described in th i 
r A , e shaping steps 
below. is reached, | permit myself to have my pillow when | go is Fer 
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it is not reached, | must place my pillow in the kitchen cupboard and sleep 
without it. 


2. Weekly: | have given $400, which | saved up to buy a stereo, to 
Sally. As | meet the weekly criterion for each step, | will receive portions of 
the money back, as specified below: 


$10 
$10 
$10 


Reaching criterion for Step 1 
Reaching criterion for Step 2 
Reaching criterion for Step 3 
Reaching criterion for Step 4 $10 
Reaching criterion for Step 5: $20 
Reaching criterion for Step 6: $20 
Reaching criterion for Step 7: $40 
Reaching criterion for Step 8 $60 
9 $80 
0 


Reaching criterion for Step 
$140 


Reaching criterion for Step 1 : 


Steps: 


Step 1: 6 instances or less per day for one week. 

Step 2: 5 instances or less per day for one week. 

Step 3: 4 instances or less per day for one week. 

Step 4: 3 instances or less per day for one week. 

Step 5: 2 instances or less per day for one week. 

Step 6: 1 instance or less per day for one week. 

Step 7: 0 instances per day for one week. 

Step 8: 0 instances per day for the second consecutive week. 
Step 9: 0 instances per day for the third consecutive week. 
Step 10: 0 instances per day for the fourth consecutive week. 


D. Potential Problems and their Resolutions 


1. | have guarded against the feeling of being strongly punished by 
the fact that if | do not meet my criterion for that week, | do not lose the 


money; | am simply delayed in buying the stereo. 


2. | will minimize the two problems of short-circuiting as follows: (1) 
| will control taking my pillow when | have not earned it by putting the pil- 
low in the kitchen cupboard at the far end of my apartment so that | have 
to walk a fair distance to get it. (2) | will control buying the stereo before 
the program is complete by reminding myself that if | bought the stereo 
prematurely | would not be able to get as good a quality stereo, because | 
would not have all the money returned to me. Also, | will inform several of 
my friends about my project and my progress, in order to avoid doing this. 


3. | have encountered a problem in deciding on which day | should 
begin my week. My baseline shows Wednesday to be a "high day." That is, 
counts are typically higher on Wednesday than any other day. My week, 
therefore, will begin on Thursday and run until Wednesday afternoon. This 
will be an incentive not to "blow a week's work in the last day of the 


week." 


E. Bonus or Penalty Clauses 


None, other than specified above. 
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F. Schedule for Review of Progress 
Every Wednesday evening with Sally. 


G. Signatures of all Involved, 
and the Dates of the Agreement 


Client Suzy — Date January 30th 

Others Involved Sally Date _ January 30th x 
Date J = 

Therapist — Date _ 


Sometimes a therapist and a client may design a program and 
prepare a contract that produces completely successful amd satik- 
factory results. Often, however, the initial contract may have to be res 
vised before success is likely to be achieved. If problems arise in tl 
following of the contract and the implementation of the pro sam "d 
tained therein, a number of relevant factors might be ae qu 
review meetings. DeRisi and Butz (1975) have suggested tl E D 
client and therapist might examine the following “trouble fe ies 
guide" when satisfactory progress is not being made babii 


Troubleshooting Guide* 


The following questions may help you to s 


your contracting system. pot the problems in 


The Contract 

1. Was the target behavior clearly specified? 

2. Did the contract provide for immediate reinforcement? 

3. Did it ask for small approximations to the desired beliavi ? 

4. Was reinforcement frequent and in small amounts? T 

3s pe) CREBRA EAD FE and eee! accomplishment rather than obedi- 
6. Was the performance rewarded after its occurrence? 

7. Was the contract fair? 

8. Were the terms of the contract clear? 

9, Was the contract honest? 

10. Was the contract positive? 

11. Was contracting as a method being used systemati 
12. Was the contract mutually negotiated? iA 
13. Was the penalty clause too punitive? 

*Adapted from William 

Pra Practice Metis (Chane M ee Behavioral Contracts: A Case 


S. 1975) pp. 58-60 
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The Client 

1. Did he understand the contract? 

2. Is he getting the reinforcer from some other source? 
3. Do the reinforcers have to be reevaluated. 


4. Has a new problem behavior developed that is drawing the mediator's 
attention away from the target behavior? 


The Mediator 


1. Did the mediator understand the contract? 

2. Did she dispense the kind and amount of reinforcement specified in the 
contract? : 

3. Did she dispense it according to instructions, at the rate specified, and 
with consistency? 

4. Did punishment accidentally accompany the performance being rein- 
forced? 

5. Did she stop mediating? 

6. Do you need a new mediator? 


Measurement 


Has the data been verified as accurate? 

Did your data collector understand what he was supposed to count? 
Did you rehearse the counting task with him? 

Did you reinforce him for his behavior? 

Is the data-collection task too complex or too difficult? 

6. Should you try to get another data collector? 


En de So NS 


CIRCUMVENTING THE THERAPIST 


It should be clear from the preceding four sections that many people 
who have mastered some behavior modification principles can use 
them to control their own behavior without having to see a therapist. 
For example, the student who has mastered this and previous chap- 
ters should have little difficulty in handling a simple behavior prob- 
lem that has been bothering her (although we would still recommend 
seeing a therapist about serious problems). Perhaps the student 
would like to decrease her smoking, nail biting, swearing, or abusive 
remarks to others. Or perhaps she would like to enhance her study- 
ing, exercising, personal tidiness, consideration of others, or public 
speaking. She probably does not really need a therapist to help her 
accomplish these goals. 

A person who has read this book already knows how to take 
data; he does not need a therapist to help him do that. He knows 
also how to plan a program and evaluate its effectiveness. He knows 
a large number of behavior modification principles and techniques 
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nd how to apply them; hence, it is likely that he can apply an ap- 
a 


i inati f them to his own case. Moreover, the pres- 
ipee Dier eee TS maie kine aware of short-circuiting, a major diffi- 
TEBA ent chap If-control programs, and has illustrated how contracting 

imi indes this difficulty. A behavioral contract can be negotiated 
gam person who is close to you and wants to help you change 
your behavior. In short, many people can be their own behavior ther- 


apist.? 


Study Questions 
(for examination purposes) 


15. 


16. 


If the laws of behavior can't be changed, how is it tha 


What suggestions does this chapter make for stre; 


. What do we mean by “significant others" 
. Describe how a simple rearrangement of ci 


. Explain how George's program to quit sm 
. Briefly describe a self- 


. What is a behavioral contract? Describe 
. What important stimulus-contr 


Is it true that behavior modifiers believe that “will power" 
terious power within you? If not, what do they think it is? 
How do self-control procedures differ from other behavior modification 
procedures? 


is some mys- 


What are the two types of "short-circuiting"? Give an example of each. 


Why should a therapist who is helping a client develop self-control 
clearly explain the reason for his advice to the client? 
After reviewing the questions in Figure 25-2, desc 
problems that clients might express in nonbehavior, 
scribe those problems in behavioral terms, 


ribe two plausible 
al terms, and rede- 


ied i t you can use them 
to change your behavior? (This is a “think” question.) 


The questions asked of the client in Figure 25-2 can 


best be summarized 
by the question “What, when, where, and why?” 


Explain. 


e ngthening record keep- 
ing by a client? 


in problems of self-control? 


onsequences might help a stu- 
reading. 


Oking included reinforcement, 


dent whose problem is getting tired while 
extinction, and stimulus control, 


reinforcement Program for reinforcing "antifa- 


tigue" thoughts. 


its essential features, 
ol functions does a behavioral contract 


How did the behavioral contract 
to alleviate potential problems o 


Is it plausible to suggest that an become their own 
behavior therapists? Justify your answer, 


for controlling the Student's anger attempt 
f short-circuiting? 


Self-Modification Exercises 


383 


(to be practiced by the reader) 


1. Utilizing the information in this and the preceding chapters, outline a 
complete self-modification program for Overcoming one of your behav- 
ioral deficiencies, excesses, or inappropriatenesses. 


2. Carry out your program and report its results. 


Watson and Tharp (1972, pp. 241-249) described several everyday 
uses of the term "will power." They state, for example, that willpower 
"often means self-restraint: ‘| had the willpower not to eat too much!’ 
Sometimes willpower means a force that enables one to pass up some 
immediate gratification in favor of a long-range goal or in favor of per- 
sonal values. Sometimes willpower is used to explain doing something 
one expects to be unpleasant. At other times the word is used to ex- 
plain doing something that is very difficult or that requires a long wait 
for positive reinforcement” (p. 248). Watson and Tharp point out, fur- 
ther, that at the onset of a self-modification program, the amount of 
“will” necessary to accomplish the end result may seem excessive. For 
a smoker, for example, the amount of "will power" necessary to quit 
“cold turkey" may seem beyond the individual's control. However, with 
the application of each step in a behavior modification program, the re- 
quired amount of "will power" seems to decrease. For example, in the 
case of the Canadian Mountie who wanted to quit smoking (see p. 374), 
the amount of "will power” necessary to take a baseline intuitively 
seemed relatively little. The amount of “will power" necessary to agree 
to the rule, "Whenever feel like a cigarette, | will go to a bathroom and 
smoke," seemed to be minimal. The amount of "will power" necessary 
to go to the bathroom to have a cigarette the first time that the smoking 
urge was experienced during the program was relatively minimal, In 
other words, Watson and Tharp argue, the greater the degree of specifi- 
cation of self-control procedures, and the smaller the step at any one 
time, the less it is necessary to consider "will power" as a factor in the 
achievement of the final goal. Whether or not "will power" can be elim- 
inated completely is unclear. It is clear that it is not useful to talk about 
the amount of “will power" needed to achieve a particular goal. How- 
ever, an individual who expresses a strong desire to achieve a particu- 
lar goal is more apt to achieve that goal than one who does not. 


You might be asking, “If the client is receiving some help from a 
consultant, in what sense is the project one of self-control?” In answer- 
ing, we would like to point out that behavioral programming might be 
viewed as a continuum varying from complete self-control to complete 
therapist control. Some procedures have been described such that the 
"average" person can read about them and then develop a self-man- 
agement program completely on his own (see, for example, Foster, 
1974; Miller and Munoz, 1976; Watson and Tharp, 1972; Williams and 
(Continued) 
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Long, 1975). Other procedures (such as aversion therapy, described in 
Chapter 14) require constant therapist supervision. The approach adopted 
in this chapter is close to the self-control end of the continuum, in that 
we describe a therapist making suggestions similar to those found in 
self-control books, and the procedures are designed and carried out by 


the client. 


Catania (1975, 1976) and Goldiamond (1976) have argued that it is 
inappropriate to call this type of procedure "self-reinforcement." Be- 
cause of the short-circuiting processes described at the beginning of 
this chapter, it appears that it may be logically impossible for people to 
directly reinforce or punish their own behavior. (No one questions the 
fact that people may do so indirectly—for example, by asking another 
person to apply a reinforcement or punishment contingency to one of 
their behaviors.) Catania and Goldiamond would argue, therefore, that 
the jogging author could not really have been reinforcing his anti- 
fatigue thoughts. This does not mean, however, that they would neces- 
sarily deny the effectiveness of the author's procedure. Rather, they 
would argue that its effectiveness must have been due to some process 
other than self-reinforcement. For example, the author's procedure may 
simply have made anti-fatigue thoughts, which were already reinforcing, 
more discriminable— hence enhancing their reinforcing effectiveness. 


As we mentioned in Chapter 2, using a behavior that occurs often to 
reinforce a behavior that seldom occurs is a principle formulated by Da- 
vid Premack, and is therefore generally called the Premack Principle. In 
Premack's words, “the most probable response of a set of responses 
will reinforce all members of a set; the least probable will reinforce no 
members of the set" (1965, p. 132). In an interesting extension of this 
principle, Homme (1965) described ways in which the Premack Prin- 
ciple might be applied to manage one's private behaviors (such as 
thoughts, images). Homme coined the phrase "coverant" (meaning ‘‘co- 
vert operant response") to refer to private behaviors that could be in- 
fluenced by their consequences. Thus, the example described in the 
text in which the author used highly probable (i.e., high-frequency) 
thoughts to strengthen an improbable (i.e., low-frequency) antifatigue 
thought is an example of both coverant control and the Premack Prin- 
ciple. A number of authors have described self-control procedures in 
which individuals successfully modified their behaviors by utilizing 
Homme's coverant control. However, in two review articles, Danaher 
(1974) and Knapp (1976) were highly critical of the available data in 
support of both the Premack Principle applied to observable behaviors 
and its extension to self-control involving coverants. Danaher and 
Knapp didn't seem to doubt the reports of behavior change by individ- 
uals claiming to use either the Premack Principle or Homme's coverant 
extension. What they questioned is the empirical evidence that the be- 
havior change was due only to the Premack Principle. They cite prob- 
lems of directly and independently measuring both the high-probability 
and low-probability responses, of obtaining adequate baselines prior to 
application of the Premack Principle, and of control of extraneous fac- 
tors that might also have influenced the improved performance 


This view was aptly expressed in the title ang contents of 
Mahoney and Thoresen (1974), Self-Control: Power to the DR E 
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In Chapter 14, we explained that systematic 

ocedure in which a client gradually Progresses 
a imagined anxiety-producing situations, 
riot the least anxiety to those that elicit the most anxiety, while 
maintaining a completely relaxed state in order to counteract the anx- 
iety. Systematic self-desensitization 1S essentially the same procedure, 
except that the client progresses through the various desensitization 
stages by himself. In other words, itis a self-modification procedure 
that is much like the self-modification Procedures discussed in Chap- 
ter 25, except that it focuses strictly on Problematic fears. We will 
therefore explain the procedure by assuming that you have an unde- 
sirable fear that you would like to eliminate (for example, a fear of 
fying). basic behavioral assumption is that f 
learned behaviors, and that by followin 
person can unlearn these behaviors, The steps we have outlined be- 
low are generally consistent with the recommendations of other be- 
evil pureueigASs GN Us area. Mere E self-desensi- 


desensitization is a 
through a hierarchy 
arranged from those that 


ear and anxiety are 
8 appropriate procedures a 


387 
Systematic 
Self- 
Desensitization 


tization program will take you through the following phases: (1) 
constructing a fear hierarchy; (2) learning deep muscle relaxation; and 
(3) carrying out the actual therapy steps of the self-desensitization 
process. 


CONSTRUCTING THE FEAR HIERARCHY 


To construct a fear hierarchy, first list from ten to thirty fear-produc- 
ing situations related to your undesirable fear. Then arrange these 
situations in order, starting with the situation that causes the least 
fear and ending with the situation that causes the most fear. To ac- 
complish this task, get a stack of three-by-five-inch index cards and 
proceed as follows. 

A. Take one of the index cards, and on the front write a brief 
phrase about the fear-eliciting situation that makes you only slightly 
nervous. For example, if your fear is that of flying, the phrase might 
be "sitting at home and phoning the airline to make a reservation." 
Now turn the index card over, and on the back list several stimuli 
that will help prompt you to realistically imagine yourself actually ex- 
periencing the phone call. The prompts might include such things as 
the color of your phone and the sound of a voice saying, "Airline 
reservations desk— may I help you?" A sample index card is shown 
in Figure 26-1. 

B. Take another index card, and list a situation that elicits a 
slightly larger amount of fear. Again, on the back of that card provide 
yourself with some verbal prompts that will help you clearly imagine 
experiencing that situation. Continue in this manner until all of the 
fear-producing situations are listed on note cards arranged so that 
each situation produces a little more anxiety than the preceding one. 
You now have a fear hierarchy. An example of a fear hierarchy for an 
individual who was afraid of flying is shown in Table 26-1. 

Note that each item in Table 26-1 refers to a specific, concrete 
situation that can be imagined in vivid detail, rather than a vague 
general idea. For example, item 10 is to be preferred to "waiting for 
the plane,” for it is more likely to prompt specific images of sitting in 
the lobby, listening to the announcements of flight numbers, and so 
forth. 

C. Your next step is to validate your fear hierarchy by making 
sure that your cards have been arranged in the proper order (they 
should start with the situation that produces the least anxiety and 
end with the situation that generates the most anxiety), and that the 
steps between them are sufficiently small (no "jump" in anxiety level 
from one item to the next should be too large). This should be done 


as follows: 


i i i hy on a scale from 0 to 100, where 100 

1 Rate s qm SAA elici Be maximum conceivable amount of anx- 

ps it means that anic and absolute terror) when encountered in the natural 

all Together ie (ene M d 0 means that the situation produces absolutely no emo- 

S i Samm aaaneted in real life. This value is referred to as the number 
Hon ee Re of discomfort (suds) elicited by the situation.’ 

jr aes h our original order of items in the hierarchy and your 

à Cheek — p consistent (each item in the hierarchy should have a 

mbes vata than the item below it and a lower ranking than the 

higher rene i ie are not consistent, redo both the hierarchy and the 

EDT do until they are completely consistent 

nion suds ratings to ensure that the dista 

3. Use cad are sufficiently small and approxima 

emm d between items should be no greate 


nces between items in the 
tely equal (rule of thumb: 
r than five to ten suds’), 


Talking to the travel agent, making reservations 


Front side 


1. Phoning the travel agent — dial number, call answered, 
2. Giving particulars of destination, dates of trip. 
3. Writing down flight numbers and times, 


4. Marking calendar with dates, flight times, ang flight numbers 


Back side 


FIGURE 26-1. A sample index card for a fear-producing situation 
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Construct new items and insert them between any items that are greater 
than ten suds apart. 


4. Number each of the cards in order, starting with the card causing the least 


ul 


anxiety as number 1. 

If you cannot make suds ratings without apparent inconsistencies be- 
tween the ratings and your hierarchy, or within the ratings themselves, 
cease your attempt at self-desensitization and seek professional clinical 
desensitization (since it would appear that several major anxieties are pre- 
sent and interacting—a condition that may be too complex to be dealt 
with by the nonprofessional). 


If a strong anxiety has occurred while you are constructing the 


hierarchy or developing your suds ratings, you might adopt one of 
two strategies: either discontinue your program and seek professional 
clinical desensitization, or continue your program but eliminate the 
five most anxiety-producing situations. After completing your desen- 
sitization program minus the five most anxiety-producing situations, 
you should then be able to develop a program for those items, since 
they will likely cause much less anxiety if you have successfully com- 
pleted the earlier items. 


TABLE 26-1. An example of a fear-of-flying hierarchy." 


Ali 


2. 


3. 


10. 


T1; 


12. 


The plane has landed and stopped at the terminal. | get off the plane 
and enter the terminal, where | am met by friends. 

A trip has been planned, and | have examined the possible methods of 
travel and decided "out loud" to travel by plane. 


| have called the travel agent and told him of my plans. He gives me 
the times and flight numbers. 


. It is the day before the trip, and I pack my suitcase, close it, and lock 


it. 


. It is ten days before the trip, and I receive the tickets in the mail. | note 


the return address, open the envelope, and check the tickets for the 
correct dates, times, and flight numbers. 

It is the day of the flight. | am leaving home. I lock the house, put the 
bags in the car, and make sure that I have the tickets and money. 


. | am driving to the airport for my flight. | am aware of every plane ! 


see. As | get close to the airport, | see several planes— some taking 
off, some landing, and some just sitting on the ground by the terminal. 
I am entering the terminal. | am carrying my bags and tickets. 

| proceed to the airline desk, wait in line, and have the agent check 
my tickets and then weigh and check my bags. 

| am in the lounge with many other people, some with bags also wait- 
ing for flights. | hear the announcements over the intercom and listen 
for my flight number to be called. 

| hear my flight number announced, and | proceed to the security 
check-point with my hand luggage. 

| approach the air-line desk beyond the security check-point, and the 
agent asks me to choose a seat from the "map" of the plane. 
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13. | walk down the ramp leading to the plane and enter the door of the 
plane. 

14. | am now inside the plane. | look at the interior of the plane and walk 
down the aisle, looking for my seat number. | then move in from the 
aisle and sit down in my assigned seat. 

15. The plane is in flight, and | decide to leave my seat and walk to the 
washroom at the back of the plane. 

16. | notice the seat-belt signs light up. so | fasten my seat belt and | no- 
tice the sound of the motors starting. 

17. Everyone is seated with their seat belts fastened, and the plane slowly 
moves away from the terminal. 

18. | notice the seat-belt signs are again lighted, and the pilot announces 
that we are preparing to land. 

19. | am looking out the window and suddenly the plane enters clouds 
and | cannot see out the window. 

20. The plane has stopped at the end of the runway and is sitting, waiting 
for instructions to take off. 

21. The plane is descending to the runway for a landing. | feel the speed 
and see the ground getting closer. 

22. The plane has taken off from the airport and banks as it changes di- 
rection. | am aware of the "tilt." 

23. The plane starts down the runway, and the motors get louder as the 
plane increases speed and suddenly lifts off. 


“This hierarchy was prepared by a client who initiated a self-desensitization project after reading 
a preliminary draft of this chapter. (Her case is described in more detail by Roscoe. Martin. and 
Pear. 1977). 


LEARNING DEEP MUSCLE RELAXATION 


After you have constructed your hierarchy, you should next learn to 
completely relax all your muscles and to recognize when they are re- 
laxed.* Do this by alternately tensing and relaxing your muscles while 
attending closely to the internal activities and sensations you are feel- 
ing at the time. Instructions for achieving deep muscle relaxation are 
presented in Table 26-2. 


TABLE 26-2. Instructions to be recorded on tape and played to achieve 
deep muscle relaxation. Each "(p)" represents a pause of five seconds. 
(The numerals should not be read aloud.) 


1. Listen closely to these instructions. They will help you increase your 
ability to relax. Each time | pause, continue doing what you were 
doing before the pause. Now, close your eyes and take three deep 
breaths. (p) (p) 
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10. 


Wil 


Te 


13. 


14. 


15. 


. Make a tight fist with your left hand. Squeeze it tight. Note how it 


feels. (p) Now relax. (p) 


. Once again, squeeze your left hand tightly and study the tension that 


you feel. (p) And once again, just relax and think of the tension dis- 
appearing from your fingers. (p) (p) 


. Make a tight fist with your right hand. Squeeze it as tight as you can, 


and note the tension in your fingers and your hand, and your forearm. 
(p) Now relax. (p) 


. Once again, squeeze your right fist tightly. (p) And again, just relax. 


(p) (p) 

Make a tight fist with your left hand, and bend your arm to make your 
left biceps hard. Hold it tense. (p) Now relax totally. Feel the warmth 
escape down your biceps, through your forearm, and out of your fin- 
gers.(p) (p) 

Now make a tight fist with the other hand, and raise your hand to 
make your right biceps hard. Hold it tight, and feel the tension. (p) 
Now relax. Concentrate on the feelings flowing through your arm. 


(p) (p) 

Now, squeeze both fists at once and bend both arms to make them to- 
tally tense throughout. Hold it, and think about the tension you feel. 
(p) Now relax, and feel the total warmth and relaxation flowing 
through your muscles. All of the tension is flowing out of your finger- 
tips.(p) (p) 

Now, wrinkle your forehead and squint your eyes very tight and hard." 
Squeeze them tight and hard. Feel the tension across your forehead 
and through your eyes. Now relax. Note the sensations running 
through your eyes. Just relax. (p) (p) 


Okay, squeeze your jaws tight together and raise your chin to make 
your neck muscles hard. Hold it, bite down hard, tense your neck, and 
Squeeze your lips really tight. (p) Now relax. (p) (p) 

Now, all together, wrinkle up your forehead and Squeeze your eyes 
tight, bite down hard with your jaws, raise your chin and tighten up 
your neck, and make your lips tight. Hold them all, and feel the ten- 
Sion throughout your forehead, and eyes, and jaw, and neck, and lips. 
Hold it. Now relax. Just totally relax and enjoy the tingling sensations. 
(p) (pb) (p) 

Now, squeeze both your shoulders forward as hard as you can until 
you feel your muscles pulling tightly right across your back, especially 
in the area between your shoulder blades. Squeeze them. Hold them 
tight. Now relax. (p) (p) 


Now, squeeze your shoulders forward again, and at the same time, 
Suck your stomach in as far as you can and tense your stomach mus- 
Cles. Feel the tension throughout your stomach. Hold it. (p) Now relax. 
(p) (p) 

Now, one more time, squeeze your shoulder blades forward again, 
Suck in your stomach as far as you can, tense your stomach muscles, 
and feel the tension throughout your upper body. Now relax. (p) (p) 
Now, we are going to review all of the muscle Systems that we have 
Covered so far. First, take three deep breaths. Ready? Tighten up both 
fists and bend both of your arms to squeeze your biceps tight. Wrinkle 
your forehead and squeeze your eyes tight. Bite down hard with your 
jaws, raise your chin, and hold your lips tight. Squeeze your shoulders 
forward and suck in your stomach and push your stomach muscles 
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against it. Hold them all. Feel the tremendous tension throughout. 
Now relax. Take a deep breath. Just feel the tension disappearing. 
Think about the total relaxation throughout all of your muscles—in 
your arms, in your head, in your shoulders, in your stomach. Just re- 
lax. (p) (p) 

16. Now, let's go to your legs. Bring your left heel in tight towards your 
chair, push it down hard, and raise your toes so that your calf and 
your thigh are extremely tense. Squeeze your toes up, and push your 
heel down hard. (p) Now relax. (p) (p) 

17. One more time, bring your left heel in tight towards your chair, push it 
down hard, and raise your toes so that your calf and your thigh are 
extremely tense. Push down on the heel and raise your toes. Now re- 


lax. (p) (p) 

18. Now, bring your right heel in tight towards your chair and push it 
down and raise your toes so that your calf and your thigh are ex- 
tremely tense. Push your heel down, squeeze your toes up, and 
squeeze your leg in tight. (p) Now relax. (p) (p) 

19. Now, let's do both legs together. Squeeze your heels in tight towards 
your chair, push down on your heels, and raise your toes as high and 
as tight as you can. Hold it. (p) Now relax. (p) (p) 


20. Now, take three deep breaths. (p) Now, tense all of the muscles as 
they are named, exactly as you have practiced: left fist and biceps, 
right fist and biceps, forehead, eyes, jaw, neck, lips, shoulders, sto- 
mach, left leg, right leg. Hold it. (p) Now relax. (p) (p) Breathe in 
deeply three times and then repeat the total tensing and then the total 
relaxing, and while you are breathing in deeply and then tensing and 
then relaxing, notice how relaxed all of your muscles feel. Now tense 
(p) and relax (p). Now, breathe normally and enjoy the completely ten- 
sion-free state of your body and muscles. (p) (p) (p) (p) (p) (p) 
Now turn the tape off. 


"Persons who wear contact lenses should remove them before doing this exercise 


It would be maximally effective for you if a friend with a low, even, 
soothing voice could record these relaxation instructions on tape. 
That way, you can listen to them rather than having to read them.’ 
While your friend is reading the instructions, he or she should pause 
five seconds for each “(p)” that appears in them. 

Let us assume that the instructions have been recorded on tape. 
You should now find a quiet, dimly lit, private setting with as few 
distracting stimuli as possible; a comfortable couch, bed, or reclining 
chair; and a time when you will not be interrupted for twenty to 
thirty minutes. Lie or sit on the couch, bed, or chair, which should 
support you with minimal use of your own muscles. Now turn on 
the tape recorder and follow the instructions. 

After you have practiced the relaxation method on several dif- 
ferent occasions, you will find that you are able to skip some of the 
steps and achieve the same deeply relaxed state in a shorter period of 
time. Eventually, you should be able to go directly to step 20 and 
achieve a completely relaxed state within a matter of minutes. We 
recommend that you gradually eliminate steps according to the fol- 
lowing pattern: 
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1. Practice the entire twenty steps in Table 26-2 on at least three occasions 
spread over a minimum of two days. 


2. Make a new tape recording consisting of steps 1, 8, 15, and 20. Use this 
new tape on at least three occasions spread over a minimum of two days. 


3. Make a new tape consisting of steps 1 and 20. Use this new tape on at 
least two occasions spread over a minimum of one day. 


After completing this program, which takes approximately one 
week, you should be able to totally relax in a matter of minutes. 
When you accomplish that goal, you are ready to begin the next 
phase of your self-desensitization program. You should not attempt 
to apply relaxation procedures in the actual fear-producing settings 
until you have completed the above training. Even then, it would be 
best to wait until your self-desensitization program is progressing 
smoothly before making any unnecessary contacts with the actual 
fear-producing stimuli. 


IMPLEMENTING THE SELF-DESENSITIZATION PROGRAM 


Now that you have constructed your fear hierarchy and are able to 
relax completely within minutes, you are ready to start your pro- 
gram. This is done according to the following steps. 


l. Find a quiet, private place that is free from distractions (preferably, the 
same place in which your relaxation practice sessions were conducted). 
Place your stack of cards containing the fear items within easy reach. The 
cards should be in order, with the least fear-producing card on top and 
the most fear-producing card on the bottom. 


N 


3. Take several minutes and relax completely, as you have been practicing 
prior to this session. 

4. When you are in a state of complete relaxation, take the card on top of 
the deck and look at the brief phrase that characterizes the situation that 
would normally cause some slight anxiety. Now turn the card over and 
look at the prompts that are to help you visualize the first situation 
clearly and vividly. After looking at the prompts, close your eyes and try 
to imagine that you are actually in that situation, as prompted by your 
card. After about ten seconds, place the card in a separate pile and to- 
tally relax. Relax for about thirty seconds, and during this time com- 
pletely forget about the scene that you have just imagined. Think only of 
your muscles and how completely relaxed you feel while breathing 
deeply. 

5. Now pick up the same card again, and then close your eyes and imagine 
that situation for at least ten seconds. Put the card down in a separate 
place, and completely relax for another thirty seconds. During this time 
do not think of the scene that you were just imagining while in a relaxed 
state. After the thirty seconds are up, consider the amount of anxiety you 
felt while imagining this scene the second time. If you were able to 
imagine the scene with approximately five or fewer suds, then vou are 
ready to proceed to card two. lf you felt more than five suds of anxiety, 
you should repeat the above routine once or twice more. If vou felt less 
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than five suds of anxiety, then relax for two minutes and repeat the 
procedure with the second card. 


6. If you have great difficulty in imagining a scene, or in relaxing while 
imagining it, or if you feel more than ten suds of anxiety, immediately 
stop imagining and induce deep muscle relaxation for a minute or two 
Then repeat the item for only three to five seconds rather than a full ten 
seconds. 

7. If step 6 doesn’t work, go back to the previous item and imagine that 
item for twenty seconds on two successive presentations of the item 
Then, again try the item that caused the difficulty. ; 


8. If you still have problems with a particular item, try to construct three 
new items with smaller steps between them in order to correct the diffi- 
culty encountered with that item. Proceed through the new items exactl 
as described above. acuy 

9. In general, you should be able to proceed through one to four items per 
session. However, it is all right to go as slow as one item per Jesion, if 
necessary. On the other hand, if you do not feel anxiety, you should not 
hesitate to go through as many as four items per session, or perhaps 
more. 


10. Each session should begin with an item that was 
; s ? n a as complet s 2 
in the previous session. pleted successfully 


T1. Sessions should not last more than about twenty minutes. Sessions 
might be conducted as frequently as twice per day and no less fre " hts 
than twice per week. quenuy 


12. If you experience difficulties that do not yield to the corrective procedures 
in steps 6-8, cease self-desensitization attempts A 
a bases and seek 
clinical desensitization. P ek professional 


It is important to keep track of your progress. Thus, at the end of 
each session, you should record on a separate sheet of aper th 
name and number of the particular items you imagined e cnn E e 
the number of exposures to each item successfully imagined m * X 
ratings of the items completed in that session, and the dat ia a s 
session. We also recommend that you graph your data in ate of the 
is meaningful to you. To better understand your progres 
also indicate the suds rating of the item when Sy ^ 
your anxiety hierarchy and the final suds rating, which j . : 
be less than five. In addition, if in real life you erie i i y, ien 
situation represented by a successfully completed vnd e actua 
suds rating in the real situation and compare it with assess your 
when imagining the situation. This will give you some ore de 
the success of your generalization to the natural environ ien - 
desensitization data taken by the client who prepared ti Lx 2 
shown in Table 26-1 is presented in Table 26-3. feast ets 


a way that 
you should 
st prepared 


CONDITIONS UNDER WHICH PROFESSIONAL ASSISTANCE 
SHOULD BE SOUGHT 


Watson and Tharp (1972, p. 189) suggest that i ; 
be sought if any of the following m at professional assistance 


TABLE 26-3. Data recorded by the client whose fear-of-flying hierarchy is shown in Table 
26-1. (For the descriptions of the items listed in the table, see the corresponding item num- 


SUDS RANKING OF ITEMS 
WHEN ENCOUNTERED IN 
THE NATURAL ENVIRONMENT 
SUDS RANKING OF ITEMS 1ST CONTACT 2ND CONTACT 


ORIGINAL IMMEDIATELY AFTER (OUTBOUND (RETURN 
SESSION SUDS DESENSITIZATION OF FLIGHT: FLIGHT: 
(AND DATE) TASK RANKING* THOSE ITEMS AUG. 26) SEPT. 6) 
1 Prepare 
(Aug. 11) hierarchy and 
do suds 
ranking on 
all items 
2 Prepare cards 
(Aug. 13) 
3 
(Aug. 14) 
4 Learn 
(Aug. 15) deep 
5 muscle 
(Aug. 16) relaxation 
6 
(Aug. 17) 
7 
(Aug. 18) Item 1 0 0 0 0 
2 5 0 5** -t 
3 6 0 6"* =t 
4 10 0 0 0 
5 13 0 0 —t 
8 6 17 0 0 0 
(Aug. 19): 7 23 0 1 0 
8 27 0 0 0 
9 29 0 0 0 
10 30 0 0 0 
11 35 0 1 o 
9 12 38 0 0 0 
(Aug. 20) 13 43 0 0 0 
14 46 0 0 0 
10 15 50 0 0 0 
(Aug. 21) 16 60 0 0 0 
» 17 70 0 0 0 
11 18 75 0 0 0 
(Aug. 22) 19 80 0 =f -t 
20 90 0 1 0 
12 21 97 3 3 0 
(Aug. 23) 22 99 9 9 10 
23 100 6 (25) 5t 0 


“The original suds ranking was done during session 1 

""These items were encountered in the natural environment prior to desensitization training. 

These items were not encountered in the natural environment. 

tWhen the plane suddenly moved from the end of the runway after having been stopped, the client was unprepared 
and a suds ranking of 25 resulted. However. she was able to recover her composure during the actual Situation and 
reduce her anxiety to a suds ranking of 5. 
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1. Uncomfortable anxiety during the creation of the hierarchy. 


2. Overlapping hierarchies, indicated by contradictory or paradoxical suds 
ratings of the items. 


3. Inability to produce vivid imagery. 
. Inability to control the beginning or ending of an image. 


5. The inability to desensitize high enough up on the hierarchy to meet your 
goals. 


e 


Wenrich, General, and Dawley (1976) have also outlined several 
potential problems in systematic self-desensitization. Nevertheless, as 
indicated by Wenrich et al., there is evidence in support of the gen- 
eral recommendations of this chapter. It appears that individuals can 


learn to overcome their own fears by following the specific proce- 
dures of self-desensitization.’ 


Study Questions 


(for examination purposes) 


1. Briefly explain the difference betw S i 
een systema siti i 5 
tematic self-desensitization. yfematic desensitization and Sp 


. List the three main phases of a i 
t systemat - sitizati i 
Scribe each in a paragraph or Tess ic self-desensitization project. De- 


3. What is a fear hierarchy (in two or three sentences)? 


. What is a suds rating? How are suds ratings used? 
i ak eee again - of the section entitled "Learning Deep Muscle Rel 

HUN) ere are Several suggestions that amount to usi is cibus] in 

ucement. Briefly describe three such Suggestions Pen 

- When carrying out a self-desensitiz, i 


` J ation program indi 
1 RC (Ww : 
nanl do if the anxiety felt while imaginin E what should an indi 3 
than ten suds? B a particular scene is greater 

7. How fast should one go 
thro i ; 
program? B ugh the hierarchy in a self-desensitization 
What are the conditions under 


3 which self- itizati 
continued and professional advice sought? desensitization should be dis- 


Self-Modification Exercise 
(to be practiced by the reader) 
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This rating scale was first recommended by Wolpe and Lazarus 
(1966). They assumed that attaching numerical values to subjective 
evaluations of one’s discomfort may help an individual to more con- 
sistently identify items in a hierarchy that are approximately the same 
distance apart in terms of the amount of anxiety they produce. How- 
ever, one’s skill at developing a suds rating will probably depend upon 
the extent to which she has learned to label those private behaviors ac- 
curately. Although Skinner (1957) has provided a plausible theoretical 
account of how we learn to label private behaviors, research in this 
area is sadly lacking. 


Although others have also recommended that the distance between 
items be approximately five to ten suds (such as Wenrich et al., 1976, p. 
28), this figure seems to be based on informal clinical observations 
rather than on rigorous empirical data. 


Since Jacobson (1938) first described his relaxation method, a num- 
ber of individuals have described different variations on the method 
(see, for example, Goldfried and Davison, 1976; Rimm and Masters, 
1974; Watson and Tharp, 1972; Wenrich et al., 1976). The present de- 
scription of the tension-relaxation induction approach was influenced 
by our reading of these sources. 


In introductory courses in psychology, students are often told that 
behaviorists deal only with measurable behavior and do not consider 
such "mental events" as sensations, feelings, and images. Although 
some behaviorists might be that way, those who ascribe to the analysis 
of behavior offered by B. F. Skinner clearly are not. As Skinner has ar- 
gued repeatedly, a small part of the universe is "private." It is possible 
to offer an interpretive explanation of the control of private behaviors. 
The reader who is interested in a more detailed discussion of a behav- 
ioral approach to private events should consult Skinner (1953, pp. 227- 
294; 1969, pp. 221—297) and Day (1969). This approach is called “radical 
behaviorism" because it assumes that private behaviors (i.e., so-called 
"mental events") are no different, in principle, from public behavior or 
any other aspect of the physicai universe. 


On the basis of clinical observations, Goldfried and Davison (1976) 
suggested that having clients practice relaxation exercises at home 
without accompanying tapes as guides seldom does little good and may 
often be harmful. 


Goldfried and Davison (1976) have described a number of potential 
therapeutic applications of relaxation, in addition to the role it plays in 
systematic desensitization. 


Another variation on desensitization procedures is referred to as “in 
vivo desensitization.” This is a procedure in which the individual desen- 
sitizes a fear in “real life" (i.e., in vivo) rather than desensitizing the fear 
in her imagination, as described in this chapter. The steps for in vivo 
desensitization are very similar to those described in this chapter, ex- 
cept that rather than progressing through a hierarchy of imagined fear 
situations the individual actually approaches the fear-producing stimuli. 


(Continued) 
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COGNITIVE 
BEHAVIOR 


MODIFICATION 


Although behavior modifiers have generally tended to reject other 
psychological approaches (such as Freudian psychoanalysis), some 
blending is taking place between behavior modification and certain 
types of treatment collectively called cognitive therapy. The word cog- 
nition means "belief," "thought," "perception." Accordingly, cogni- 
tive therapists regard their approach to be primarily that of helping a 
client overcome his difficulties by getting rid of unproductive, debili- 
tating thoughts or beliefs and adopting more constructive ones. Some 
behavior modifiers have noted certain similarities between the goals 
and procedures of cognitive therapists and their own. Cognitive ther- 
apists, in turn, have adopted some behavior modification methods. 
Out of this mutual appreciation has grown an area that has come to 
be known as cognitive behavior modification (see Mahoney, 1974; Mei- 
chenbaum, 1974). The purpose of this chapter is to briefly describe 
some of the procedures that are often considered to fall within this 
area. But first, a word about words. 


“THINKING,” “BELIEVING,” AND PRIVATE BEHAVIOR 
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Behavior modifiers generally believe that they can best discover and 
apply effective procedures if the terms they use to talk about behav- 
ior are clear and precise. This is why they have developed a special 
language consisting of well-defined terms (such as reinforcer, S", S>, 
and contingency of reinforcement). They have also tended to avoid 
certain everyday words, such as “thinking” and “believing,” that are 
used quite freely by other social scientists. 

Of course, it is not necessarily incorrect to say that someone 
“thinks that ..." or "believes that ...” such and such is the case. 
Obviously, such words serve well in everyday conversation. It’s just 
that there are usually more precise ways of talking about behavior 
and behavioral procedures. Although every example presented in this 
book could have been stated in terms of someone "thinking" or “be- 
lieving" something about the reinforcement contingencies controlling 
her behavior, we generally did not do this. Mixing vague, everyd 
conversational terms with the more precise technic 
only have confused the issue by m 
less clear and precise ( 


ay 
al language would 
aking the technical descriptions 
see Skinner's comments in note 1 of Chapter 2). 
When talking about public (i.e., overt or observable) behavior, 
most behavior modifiers are quite consistent and precise. However, 
as some behavior modifiers have taken more of an interest in private 


behavior, the language seems to be getting more variable and less 
precise. Throughout this text, we hav 


that behavior modifiers have concentr. 
because of its amenability to direct ob 
and because most behavioral problem 


avior. When solving a 
for example, a person may "talk silently to him- 
self" and these private self-statements may be part of a behavioral 
chain (or sequence) that leads him to the correct solution. He may 
also imagine (that is, engage in private "seeing behavior") certain as- 
pects of the problem, and these images may also be part of the be- 
havioral chain leading to the solution. A number of behavior modi- 
fiers have tended to equate private behaviors such as these with 
words such as “thinking” and “believing.” 

The problem with the everyday terms 
ing” is that they do not refer precisely to the 
est (whether it is private or public) 
behavior. Moreover, to u 
“thinking” 


“thinking” and “believ- 
actual behavior of inter- 
and the variables controlling that 


; "believing" and 
to refer to private behavior implies th i 
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and procedures applicable to private behavior are fundamentally dif- 
ferent from those that apply to public behavior. Although private be- 
havior is more difficult to "get at," we may assume that in other re- 
spects it is the same as public behavior. Although this assumption is 
currently unproved, it does appear to be scientifically and practically 
useful. For example, in Chapter 25 we described how George in- 
structed himself to go to the washroom every time he felt like having 
a cigarette. Although he probably gave himself this instruction 
silently rather than out loud, its effect was the same in either case. 
He followed his self-instruction, and his smoking decreased. In 
Chapter 25, we also described how one of the authors, while jogging, 
increased his antifatigue thoughts by following them with thoughts 
of a highly reinforcing activity. Although the effect was probably not 
as strong as it would have been had his jogging been immediately 
reinforced with the actual experiences that he merely imagined, the 
principle was still the same. (But see note 3 of Chapter 25.) In Chapter 
26, we described how a client self-desensitized her fear of flying by 
imagining the fear-producing situations while in a relaxed state. 
Presumably, the private "seeing behavior” (imagining) was so similar 
to actually seeing the fear-producing situations that the relaxation 
response generalized to those situations. 

In each of these cases, as well as in a number of other examples 
presented in this book, private behavior was modified in order to 
bring about desired changes in public behavior. In no case, however, 
was it necessary to assume that private behavior is fundamentally 
different from public behavior. In no case was it necessary to use 
vague terms such as "believing" and "thinking" to distinguish pri- 
vate behavior from public behavior. On the contrary, the treatments 
used were based on the assumption that the same general principles 
and procedures are applicable to both public and private behavior. 

From this point of view of public and private behavior, we will 
now discuss some methods that others have called "cognitive" pro- 
cedures. 


SOME COGNITIVE PROCEDURES 


Cognitive therapists and cognitive behavior modifiers speak of 
achieving desirable changes in a client's behavior (including emo- 
tional behavior) by altering thought patterns, beliefs, attitudes, and 
opinions. Their methods, however, deal mainly with the client's pri- 
vate verbal behavior and images relating to himself and the world 
around him. Much of the evidence supporting the effectiveness of 
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these techniques comes from case studies rather than from well-con- 
trolled experiments. 


Rational-Emotive Therapy 


Cognitive behavior modification has received strong impetus 
from the well-known cognitive therapist Albert Ellis (see, for ex- 
ample, Ellis, 1962; Ellis and Harper, 1975). A psychotherapist origi- 
nally trained in Freudian psychoanalytic methods, Ellis became very 
disillusioned with those methods. He found that although his clients 
perhaps gained some insight into their problems by remembering 
and talking about their childhood experiences, this insight was of 
little value in solving their problems. Ellis became convinced that the 
solutions were to be found in the situations in which the problems 
are encountered, not in the client’s distant past. In shifting the focus 
of treatment to the client’s present environment, Elli 
he called rational-emotive therapy. 

As its name suggests, rational-emotive therapy is b 
premise that there is a very close connection b 
ourselves and how we feel. According to Elli 
tional problems (and related behaviors) 
ments people make to themselves when e 
the way they would like them to be. People tend to "catastrophize": 
they tell themselves that things are so horrible they can't possibly 

stand it." Basically, Ellis's approach is to teach his clients to 


counteract such "irrational" self-statements With more positive and 
realistic statements. For example, 


they may tell themselve 

item à s that al- 
though their situation may be annoying or inconvenient, it is not cat- 
astrophic, and, moreover, there are usually things that they can do to 
improve it.” (For example see Figure 27-1). 


An important component i i 
of rational-emotive th i 1 
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SCIENTISTS HAVE JUST LEARNED 
THAT THE EARTH WILL CRASH 
INTO THE SUN WITHIN 24 HOURS, 


OH WELL, ITS NOT SO 
BAD. THERE ARE STILL 
OTHER PLANETS. 


Figure 27-1. An extreme example of rational-emotive therapy. 


ity (the client may be telling himself that it is better to make love 
with another man than to risk the “terrible fate" of being rejected by 
a woman); and lack of self-confidence and subsequent failures (the 
client may be telling herself that she will inevitably fail at whatever 
she attempts, and that such failure will only prove once again what a 
rotten person she is). An interesting question that has yet to be 
tested scientifically is the extent to which people really do tell them- 


selves such things. 


Self-Instructional Methods 


Donald Meichenbaum (1974), one of the leading cognitive be- 
havior modifiers, has strongly emphasized the role of self-instruction 
(that is, telling oneself what to do in various situations) in bringing 
about desired behavior changes. Like Ellis, he teaches clients to rec- 
ognize their negative self-statements and to counteract them with 
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more realistic, positive statements (see Meichenbaum, 1975). In addi- 
tion, he uses the relaxation method (described in Chapter 26) and 
other behavior modification techniques. In general, his approach cen- 
ters on teaching the client to instruct himself to engage in appropriate 
"coping" behavior in situations that cause anxiety or stress. The em- 
phasis is more on coping with the negative emotions than on com- 
pletely eliminating them. For example, following treatment, one pho- 
bic client said; "It (self-instructing) makes me able to be in the 
situation, not to be comfortable, but to tolerate it. 1 don't talk myself 
out of being afraid, just out of appearing afraid. ... You immediately 
react to the thing you're afraid of and then start to reason with your- 
self. I talk myself out of panic." (Meichenbaum, 1975, p. 371) 

The client is taught to respond to certain stimuli produced by 
the stressful situation, and by his own behavior in that situation, as 
SPs for engaging in appropriate self-instruction. The coping behav- 
ior generally includes counteracting negative self-statements and in- 
ducing relaxation in the presence of the stressful situation. Some- 
times it also involves reinterpreting one’s emotions—that is, saying, 
things to oneself that presumably make the negative emotions less 
aversive. For example, the client may be instructed to say to himself, 
“The reason my heart beats fast and my legs feel wobbly when I’m 
with a woman I like is because I’m sexually aroused, not because I'm 
terribly afraid"; or, “The fact that I’m anxious before giving a speech 
doesn’t mean I'm going to blow it—my anxiety is just a way of pre- 
paring me to be alert and do a good job.” The client is also instructed 
to make reinforcing self-statements immediately after he has success- 
fully coped with the stressful situation (for example, “I did it!" and 
“Wait until I tell my therapist about this!) 

To help the client develop coping 
stressful situations in the natural envir 
give him "stress inoculations.' 
unpredictable electric shocks or 
exposed in the therapy setting. 
client practices appropriate co 
client to recall stressful situati 


Skills before he deals with 
onment, the therapist may 
These are stressful stimuli, such as 


able to cope. 


Besides working with adults, Meic 
instructional techniques in helpin 
children to manage their be 


henbaum has also used self- 
; g hyperactive and withdrawn 
havior (see Meichenbaum, 1977). 

Problem Solving 


Teaching people how to 


- proceed through logic 
satisfactory solutions to person 


al reasoning to 
al problems is 


another approach that 
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is sometimes considered to fall within the area of cognitive behavior 
modification. D'Zurilla and Goldfried (1971) outline the following 
five general steps in personal problem solving. 


1. General orientation: The client is encouraged to recognize problems and to 
realize that it is possible to deal with them by acting systematically rather 
than impulsively. The client may be taught to recognize problems by 
being presented with common examples of them and/or by being asked 
to describe such situations that she has encountered in her own life. 
Problem definition: When asked to specify the problem, most clients reply 
in very vague terms — for example, "I've been very upset lately.” By clearly 
specifying the history of the problem and the variables that seem to be 
controlling it, it is generally possible to define the problem more pre- 
cisely. For example, a close analysis might indicate that what is upsetting 
the client is that she shares an apartment with a very untidy roommate, 
and she can't stand the "mess" she feels forced to live in. 

3. Generation of alternatives: After precisely defining the problem, the client 
is instructed to “brainstorm” possible solutions— that is, to “let her mind 
run free” and to think of as many solutions as she can, no matter how far- 
fetched. For example, possible solutions that she might come up with are 
(a) to move, (b) to self-desensitize to messiness, (c) to speak assertively to 
her roommate about keeping the place neat, (d) to try to shape neat be- 
havior in her roommate, (e) to negotiate a behavioral contract with her 
roommate, (f) to throw her roommate's things out the window, and (g) to 
throw her roommate out the window. 


4. Decision making: The next step is to carefully examine the alternatives, 
eliminating those that are obviously unacceptable, such as (f) and (g). She 
should then try to estimate the likely effectiveness and the likely short- 
range and long-range consequences of the remaining alternatives. On the 
basis of these considerations, she should select the alternative that seems 
most likely to provide the optimum solution, and (with the help of the 
therapist) devise a plan for carrying it out. 

5. Verification: When the plan is put into effect, does it solve the problem? 
That is, is the client satisfied? If not, the problem-solving sequence must 
be started again and another solution attempted. 


N 


Thought-Stopping 


Thought-stopping (Wolpe, 1958) is used in cases in which a per- 
son engages in persistent, obsessive private verbal behavior that he 
cannot seem to control. (If you've ever had a tune that just kept going 
through your head no matter what you did to try to get rid of it, you 
probably have some idea of the nature of this problem.) The proce- 
dure involves, first, instructing the client to think the obsessive 
thought. The therapist then suddenly yells "Stop!" Immediately, ac- 
cording to anecdotal clinical reports, the undesirable private verbal 
behavior ceases. After a few such trials demonstrate the effectiveness 
of the procedure, the client himself is instructed to yell “Stop!” while 
he is engaging in the undesirable private behavior. Again, the be- 
havior ceases. Over trials, the self-instruction “Stop!” is faded to the 
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private level so that eventually the client can "turn off" the undesir- 
able private behavior simply by “yelling” "Stop!" silently to himself. 
An interesting variation of this procedure was reported by 
Rimm and Masters (1974, p. 434). They described the case of a young 
man who was obsessed with self-statements concerning “having a 
nervous breakdown” or “going crazy." Instead of interrupting the 
negative thoughts by covertly shouting "Stop!" the client, with the 
help of the therapist, worked out a slightly different procedure. 
Whenever he was disturbed by his negative self-statements about go- 
ing crazy, the client said to himself; “Screw it! I'm perfectly normal.” 
Although thought stopping has been generally used to manage 
obsessive private verbal behavior, Cautela and Wisocki (1977, p. 259) 
claim that it "may also be employed with feelings and images as well 
as several overtly observable behaviors." They also acknowledge that 
empirical support for the effectiveness of the procedure is weak. 


Other Cognitive Techniques 


din, and Mahoney (1976, P. 151): 
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with private verbal behavior and images, as well as public behavior.? 
They do not appear to involve any behavior principles besides those 
discussed in the previous chapters of this book. All behavior prac- 
titioners should be open to innovative procedures for helping people 
change their behavior. At the same time, there are advantages to ex- 
amining such procedures from a consistent behavioral viewpoint. 

As some behavior modifiers become more involved with the 
realm of private behavior, we can anticipate many exciting devel- 
opments. Nevertheless, covert behavior modification is still very 
much in its exploratory stages. It is not yet possible to make defini- 
tive statements about the effectiveness of its procedures. 


Study Questions 


(for examination purposes) 


1. Cognitive behavior modification is a blend of what two types of treat- 
ment? 

2. What does the word "cognition" mean? 

3. Why have behavior modifiers tended to avoid certain everyday language 
words, such as “thinking” and "believing"? 

4. Do reputable behavior modifiers deny the existance and importance of 
private behaviors? Discuss. 

5. Describe several examples cited in this chapter and Chapter 25 in which 
individuals' private behaviors influenced their public behaviors. 

6. What basic assumption do the authors of this text make about public and 
private behavior? 

7. What do cognitive therapists and cognitive behavior modifiers mainly 
deal with? (See p. 401.) 

8. What is rational-emotive therapy? Who developed it? 

9. According to Ellis, rational-emotive therapy has been used successfully to 
improve what types of problems? Explain briefly. 

10. How does Meichenbaum's self-instructional approach differ from Ellis's 
rational-emotive therapy? 

11. What are "stress inoculations"? 

12. In two or three sentences each, outline the five steps of problem solving 
described by D’Zurilla and Goldfried? 

13. Briefly outline the procedure of thought-stopping. 

14. Why is covert reinforcement considered a cognitive technique? 

15. In half a page or less, outline the authors’ view of cognitive techniques, 
as described in this chapter. 


408 16. Choose a hypothetical problem and describe how you think it might be 

Putting it modified through the use of covert reinforcement. 

all Together 17. Choose a hypothetical problem and describe how you think it might be 
modified through the use of covert extinction. 


18. Choose a hypothetical problem and describe how you think it might be 
modified through the use of covert punishment. 


19. Choose a hypothetical problem and describe how you think it might be 
modified through the use of covert modeling. 


In the last chapter of his book Verbal Behavior, Skinner (1957) 
closely examines what the words "thinking" and "thought" seem to 
mean in everyday language (that is, what sorts of activities seem to 
evoke phrases such as "| was thinking ..." and “I thought that ..."’). 
He considers several possibilities. One view is that thinking is simply 
covert verbal behavior. For example, People often talk silently to them- 
selves when solving problems, and this silent self-talk is often called 
“thinking.” However, essentially the same kind of self-talk may also be 
emitted overtly, rather than covertly, as when people "think out loud." 
Although most people usually talk to themselves silently rather than 
aloud, this is merely because silent talk requires less effort, and (per- 
haps more important) because talking to oneself aloud is frequently 


punished (it distracts other people, and it reveals things that may dis- 
please them). There is nothing special about silent self-talk, as opposed 

to overt self-talk, that causes it to merit the special label "thinking." 

Skipper therefore rejects the view that thinking is merely covert verbal 
ehavior. 


Skinner also rejects the view that thinking is simply self-talk since 
he sees no essential differences between verbal behavior directed toward 
the self and verbal behavior directed toward others. 

: Another view is that thinking is simply verbal behavior. Skinner re- 
jects this view also. People often imagine thin 
they often engage in private Seeing, hearin 

ior), and this is often called "thinking." Yet it is not verbal behavior. 

Finally, Skinner (1957, pp. 449- 1 
nothing more or less than behaving: 


t - . . When we study human th 
study behavior. In the broadest Possible sense, the thought of ie Ges 


this sense, 
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According to Ellis and Harper (1975), our culture fosters a number of 
irrational beliefs or ideas that account for most of the common forms of 
emotional distress (and related behavioral difficulties) that people expe- 
rience. The ten most common of these ideas are: 


A. “the idea that you must—yes, must—have love and approval from all the 
people you find significant” (p. 88); 

B. "the idea that you must prove thoroughly competent, adequate, and achiev- 
ing," or, "that you must at least have competence or talent in some impor- 
tant area" (p. 102); 

C. "the idea that when people act obnoxiously and unfairly you should blame 
and damn them, and see them as bad, wicked, or rotten individuals" (p. 113); 

D. “the idea that you have to view things as awful, terrible, horrible, and cata- 
strophic when you get seriously frustrated, treated unfairly, or rejected" (p. 
124); 

E. "the idea that emotional misery comes from external pressures and that you 
have little ability to control or change your feelings" (p. 138); 

F. "the idea that if something seems dangerous or fearsome, you must pre- 
occupy yourself with and make yourself anxious about it" (p. 145); 

G. "the idea that you can more easily avoid facing many life difficulties and self- 
responsibilities than undertake more rewarding forms of self-discipline" (p. 
158); 

H. "the idea that your past remains all-important and that because something 
once strongly influenced your life, it nas to keep determining your feelings 
and behavior today" (p. 168); 

|. "the idea that people and things should turn out better than they do and that 
you must view it as awful and horrible if you do not find good solutions to 
life's grim realities" (p. 177); 

J. "the idea that you can achieve maximum human happiness by inertia and in- 
action or by passively and uncommitedly enjoying yourself." (p. 186). 


Ellis and Harper sometimes speak as though these ideas exist indepen- 
dent of behavior, and are causes of it. This naturally leads one to ask 
where they exist, what they are and how they can act as causes of be- 
havior. These questions appear to be unanswerable. Skinner's position 
(see note 1, above) avoids such linguistic difficulties. To say, for ex- 
ample, that someone believes it is horrible for him to be rejected is to 
say simply that he behaves as though this were true (in other words, 
when someone rejects him, he reacts as others might under conditions 
of a major catastrophy). It does not mean that there is something called 
an "idea," “belief,” or "thought that causes him to behave in this way. 
Moreover, contrary to what Ellis and Harper imply, it does not necessar- 
ily even mean that he tells himself that things are horrible when some- 
one rejects him (although, of course, he may). This is more than an ab- 
stract philosophical point. It may have practical implications, as the 
following comment by Goldfried and Davison (1976, p. 169) suggests: 
“There are times when a client may insist that he is not telling himself 
anything while in an anxiety-provoking situation. Even if a client has 
difficulty acknowledging the existence of any irrational self-statements, 
he may be willing to accept the interpretation that, in light of his emo- 
tional overreaction to a particular situation, it is as if he did believe 
something catastrophic might occur." [italics in original] 


In addition, cognitive behavior modifiers deal largely with what 
Skinner (1969) calls “rule-governed behavior." Rules are verbal stimuli 
that describe specific contingencies of reinforcement. Because rules 
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can function as SPs, a highly verbal person may not require many ex- 
posures to a particular contingency in order to respond appropriately 
to it. She may, for example, construct a rule describing the contingency 
and then respond to the rule rather than directly to the contingency 
itself. Or, she may respond appropriately to someone else's description 
without herself having had any direct exposure at all to the contingency. 
Thus, for example, presenting a person with statistics showing that air 
travel is much safer than traveling by car may help to counteract that 


person's fear of flying— provided that the person has previously been 
successful in obtaining reinforcement or avoiding punishment by res- 


ponding to similar descriptions of empirical data. 


Study Questions on Notes 


1. Why does Skinner re 
bal behavior? 


Why, according to Skinner, do we usually talk to ourselves silently? 
9 Why does Skinner reject the view that thinking is simply verbal be- 
havior? 

What does Skinner think about thinking? 


- Choose one of the common irrational beliefs cited by Ellis and Har- 
per that you have held at one time or another. Describe some of the 
particular details of that belief. Indicate why you now believe that it 
was irrational. 

6. What is a linguistic d 

to encounter? 


7. According to Skinner, 


ticular belief (such as 
to be rejected)? 


ject the view that thinking is simply covert ver- 


ifficulty that Ellis and Harper sometimes appear 


what does it mean when someon 
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A BRIEF HISTORY 


What is behavior modification? A reader attempting to answer thi 
question from the information presented in this book might iie 


that behavior modification: 


concentrates on behavior, especially observable behavior; 
emphasizes collecting and graphing objective data, and making treatment 
oe 3 ; : ý 
decisions primarily on the basis of those data; 
is based on principles and techniques that have been researched in labora 
a- 


tory and applied studies; 
is used to bring about specific behavioral improvements in individualized 


programs; 
can be applied almost anywhere people are behaving. 


This chapter traces some of the highlights of the remarkable and 
very recent growth of the field of behavior modification. The chapter 
should be read with the following qualifications in mind: 


. Although we will describe behavior modification as developing primarily 
through two major and separate lines of influence, there are obvious 
cross-influences, blends, and offshoots, and it might be possible to make 
a case for somewhat different histories. 
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2. We will identify what we consider to be major highlights of the recent de- 


velopment of behavior modification; we will not attempt a complete his- 
torical account. 


3. Behavior modification as we know it today is primarily a product of the 


1960s and 1970s. Very few historical highlights prior to the 1950s will be 
discussed.! 


4. This chapter will describe mainly North American historical highlights.? 


THE TWO MAJOR LINES OF DEVELOPMENT 


The operant-conditioning orientation. 


In 1938, B. F. Skinner published his book, The Behavior of Or- 
ganisms, in which he described the results of experiments on the le- 
ver-pressing behavior of rats for food or water reinforcement and, on 
the basis of his findings, outlined the basic Principles of operant be- 
havior.? This pioneering work gradually influenced other experimen- 
tal psychologists to begin studying the effects of contingencies of re- 
inforcement on the behavior of rats and other animals, 


In 1950, Keller and Schoenfeld wrote an introduct 
text, Principles of Psychology, 


s of Psychology 
development of the field of behavior 
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warm sugar-milk solution was used as the reinforcer. Greenspoon 
(1955) demonstrated that a simple social consequence (saying “mmm- 
hmm") could influence college students to say certain types of words 
(see Chapter 2, note 5). Azrin and Lindsley (1956), two of Skinner's 
graduate students, demonstrated that jellybean reinforcement could 
influence pairs of young children to cooperate in playing a simple 
game. Each of these experiments demonstrated that consequences in- 
fluence human behavior in predictable ways. None of the above ex- 
periments, however, were primarily practically oriented. One of the 
first published reports of the 1950's that concerned practical, applied 
problems, was that of Ayllon and Michael (1959). With Michael as his 
Ph.D.-dissertation advisor, Ayllon conducted a number of behavioral 
demonstrations at the Saskatchewan Hospital, a psychiatric institu- 
tion in Weyburn, Saskatchewan. These demonstrations showed how 
staff could use procedures such as reinforcement, extinction, and 
escape and avoidance conditioning to modify behaviors such as de- 
lusional talk, refusals to eat, and various disruptive behaviors. 

Although it is difficult to determine the full impact of Ayllon 
and Michael's article, as well as several subsequent papers published 
by Ayllon and his colleagues from their work at Weyburn, similar 
demonstrations of behavioral control began to appear with some fre- 
quency in the early 1960s (see Table 28-1). This early work was char- 
acterized by two features: (1) much of it was done with very resistant 
populations (such as the mentally retarded, autistic children, and se- 
verely regressed psychotics) that had not received a great deal of suc- 
cessful input from traditional psychology; (2) many of the appli- 
cations took place in institutional or highly controlled settings. A 
notable exception to this early work is Bijou and Baer's (1961) inter- 
pretation of child development from a strictly behavioral perspective. 

In 1965, Ullmann and Krasner published their very influential 
collection of readings, Case Studies in Behavior Modification (see the 
"gray area" in Table 28-1). This appears to be the first book with 
"behavior modification" in its title. In addition to collecting a num- 
ber of case histories and research reports by other authors, Ullmann 
and Krasner compared behavior modification and the behavioral 
model with more traditional psychotherapeutic strategies and the 
medical model. Although their book is not just in the operant tradi- 
tion, since they also included many studies and discussions in the 
Pavlovian-Hullian tradition (to be discussed in the next section of 
this chapter), it undoubtedly had a significant impact on furthering 
behavior modification and providing, in one source, information on 
much of the preliminary work in this area. 

In the late 1960s, the operant-conditioning orientation began to 
boom throughout North America. Several university training centers 
were developed, many universities initiated at least one or two 
courses in behavior modification at both the graduate and under- 


TABLE 28-1. Some historical highlights of behavior modification and behavior therapy 


OPERANT-CONDITIONING (SKINNERIAN) ORIENTATION 


OFFSHOOTS AND MIXTURES 


PRE-1950S 


Some basic research and 


theory 
(Skinner, 1938) 


1950S 


Two major texts (Keller and Schoen- 
feld, 1950; Skinner, 1953) 


Some human studies and applications: 


e.g.,Profoundly Retarded 
(Fuller, 1949) 
schizophrenics (Lindsley, 1954) 
Psychotics (Ayllon and Michael, 
1959) 
Verbal Conditioning (Green- 
spoon, 1955) 
Stuttering (Flanagan, Gold- 
iamond, and Azrin, 1958) 

A basic operant research journal, with 
some applications (Journal of the 
Experimental Analysis of Behavior, 
1958—) 


EARLY AND MIDDLE 1960S 


Some major university training centers 
Several books of readings (e.g.. Ulrich. 
Stachnik, and Mabry, 1966) 
More applications. many to "resistant" 
populations: 
e.g..retardation (Birnbrauer, Bijou, 
Wolf, and Kidder, 1965; Girardeau 
and Spradlin, 1964), 
autism (Ferster and DeMyer, 
1961; Lovaas, 1966; Wolf, Risley, 
and Mees, 1963). 
hyperactivity, (Patterson, 1965) 
delinquency (Schwitzgebel, 1964) 
psychotics (Isaacs, Thomas, and 
Goldiamond, 1960; Haughton and 
Ayllon, 1965) 
child development (Bijou and 
Baer, 1961) 


Premack Principle (Premack, 1965) 
Coverant control (Homme, 1965). 
Precision teaching (Lindsley, 1966). 


RESPONDENT-CONDITIONING 


(AND HULLIAN AND 
WOLPEAN) ORIENTATION 


Some basic research and 
theory 

(Pavlov, 1927; Watson 

and Rayner, 1920) 
An early application of 
fear desensitization 

(Jones. 1924) 
An early application of 
assertive training 

(Salter, 1949) 


Two major texts (Dollard and Miller, 
1950; Wolpe. 1958) 
Applications of systematic desensi- 
tization, assertive training, and aver- 
Sion therapy to a variety of phobias 
and behavioral excesses. 
Comparisons of behavior therapy and 
Psychotherapy (Eysenck, 1959) 


Covert sensitization (Cautela, 1966) 


Some major university training centers 

Several books of readings (e.g., 
Eysenck, 1960; Franks, 1964) 

More applications of systematic desen- 
Sitization. assertive training, and 
aversion therapy to a variety of clas- 


Sic neurotic behaviors and sexual 
disorders. 


416 


5.6.7 Please see respective Extended Discussion and Notes at the end of this chapter 


LATE 1960S 


Additional major university training centers 
Isolated undergraduate and graduate courses in many 
universities 
Additional books describing applied research and 
procedures applicable to a variety of areas 

e.g.. education (Skinner. 1968) 

parenting (Patterson and Gullion, 1968) 

community work (Tharp and Wetzel, 1969) 

mental hospitals (Schaefer and Martin. 1969) 
Additional applications to a variety of areas, including 
self-control, delinquency. university teaching. mar- 
riage counseling. sexual behaviors. and academic 
skills 
An applied journal (Journal of Applied Behavior Analy- 
sis, 1968—) 


Token economies (Ayllon and Azrin. 1968) 
Contingency contraction (Homme et al., 1969) 


Two major books (Bandura, 1969; Franks, 1969) 


Implosive therapy (Stamptl and Levis. 1967) 


Several major university training centers 
Additional books (e.g.. Wolpe, 1969) 
More applications to phobias. anger. a 
attacks, frigidity. homosexuality, insomnia, speech 
disorders. exhibitionism. and other behaviors 


isthmatic 
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1970s 
Many "how-to-do it" books in a variety of areas* 


Behavior modification procedures described for many 
"traditional" areas of psychology (e.g.. social, devel- 
opmental, personality. abnormal, and clinical) 


Many other "helping professions" adopting behavior 
modification procedures (e.g.. medicine, social work. 
nursing. and educatior® 

Wide variety of individual, institutional, and commu- 
nity applications and research 


Numerous behavior modification-behavior therapy 
conferences and workshops 


Concern for behavior modification-behavior therapy 
as a profession, and for controls against mis- 
applications" 


Mixed paraprofessional and professional organiza- 
tions (e.g Midwestern Association of Behavior Analy- 
sis, 1974—). 

Professional organizations (Association for the 
Advancement of Behavior Therapy, 1970—; Behavior 
Research and Therapy Society, 1970—; European 
Association of Behavior Therapy, 1971—) 

Five more journals (Behavior Therapy, 1970— ; Behav- 
ior Therapy and Experimental Psychiatry, 1970— ; 
Behaviorism, 1972 —Behavior Modification, 1977 — ; 
Advances in Behaviour Research and Therapy, 1977 —) 


Many additional books, publications and training 
workshops; much additional research. 
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graduate levels, and applications spread to normal school settings; to 
university teaching, to homes, and to other populations and settings. 

By the 1970s, the operant orientation had grown tremendously. 
Applications now occur in almost all walks of life. 


The respondent-conditioning (and Hullian and 
Wolpean) orientation 


Pavlov conducted respondent-conditioning experiments in 
which he conditioned dogs to salivate at the sound of a tone (see 
Chapter 14, note 1). This work became available in English in the 
early 1900s. In 1913, John B. Watson published a very influential pa- 
per in which he argued that most human activities could be ex- 
plained as learned habits.* After becoming familiar with the work of 
Pavlov (and another Russian physiologist, I. Bechterev), Watson 
adopted the conditioned reflex as the unit of habit and argued that 
most complex activities were due to respondent conditioning (this, of 
course, was before Skinner distinguished between operant and re- 
spondent conditioning). At that time, some of his extreme and un- 
supported generalizations shook the foundations of much of the tra- 
ditional psychology. Watson followed his 1913 paper with a classic 


experiment in which he demonstrated that human emotional reac- 


tions could be conditioned in an experimental setting (Watson and 
Rayner, 1920). The experiment concerned conditioning a fear re- 
sponse in an eleven-month-old infant, "Little Albert." During prelim- 
inary observations, it was demonstrated that Little Albert was not 
afraid of a variety of things that were placed in his vicinity when he 
was happily playing on a rug on the floor. Following these observa- 
tions, Watson introduced a white rat (of which Albert had shown no 
fear) and, when Albert was attending closely to the rat, banged a 
steel bar with a hammer just behind Albert's head. The loud noise 
caused crying and other emotional behavior in Albert. After a total of 
six pairings of the loud noises with the sight of the rat, over two sep- 
arate sessions approximately one week apart, Albert showed a very 
strong fear reaction to the rat. Moreover, generalization Occurred in 


that a rabbit, a dog, a sealskin coat, and a piece of cotton also elicited 
the fear. Unfortunately, Little Albert's Parents moved away before 
Watson and Rayner had a chance to decondition the fear. However, 
subsequent experiments by Mary Cover Jones (1924) followed up 
ions and clearly demonstrated 


the elimina- 
fants through the use of respor 


ton ndent-condi- 
tioning procedures. 


During the next twenty years, a number of somewhat isolated 
reports of the application of Tespondent-conditioning procedures to 
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various behaviors appeared in the literature (for a list of many of 
these, see Yates, 1970). None of these applications, however, appear 
to have had any sustained impact on the development of behavior 
modification as we know it today. 

Another influence that seems related to the respondent-condi- 
tioning orientation was the work of the American learning theorist 
Clark Hull (1943, 1952). Hull, an early contemporary of Skinner, de- 
veloped a “learning theory” that tended to capitalize on both operant 
conditioning as described by Skinner and respondent conditioning as 
described by Pavlov, meshed together in Hull’s particular brand of 
theorizing. Hull, however, did not attempt to interpret a wide variety 
of human behaviors to the extent that Skinner did (compare Hull, 
1952 with Skinner, 1953). However, two other psychologists, Dollard 
and Miller (1950), translated a variety of Freudian psychodynamic 
concepts (which, despite their lack of empirical support, were ex- 
tremely popular in those days) into the language of Hull's learning 
theory. 

Within this Pavlovian-Hullian tradition, two significant devel- 
opments occurred in the 1950s, both no doubt influenced to some ex- 
tent by Dollard and Miller's book. One development occurred in 
South Africa, where Joseph Wolpe began some research and theo- 
rizing that drew heavily on Pavlovian conditioning, Hullian theory, 
and the earlier work of Watson, Mary Cover Jones, and the British 
physiologist Sir Charles Sherrington. Sherrington (1947) had noted 
that if one group of muscles is stimulated, an antagonistic muscle 
group will be inhibited—and vice versa. He called this reciprocal inhi- 
bition, and postulated it to be a general process acting throughout the 
nervous system. Wolpe extended the principle of reciprocal inhibi- 
tion to state that if a response that is incompatible with fear or anx- 
iety can be made to occur to a stimulus that normally produces fear 
or anxiety, then that stimulus will cease to elicit the fear reaction. In 
1958, Wolpe published his first book on reciprocal inhibition. It was 
to provide a major force in the launching of the modern era of the re- 
spondent tradition of behavior therapy. Wolpe used relaxation re- 
sponses, sexual responses, and assertion responses to reciprocally 
inhibit fear or anxiety. (When relaxation is used, the treatment pro- 
cedure is typically called systematic desensitization; see the discussion 
of assertion training and systematic desensitization in Chapter 14.) 

Also during the 1950s, Hans Eysenck in England was in- 
strumental in criticizing traditional Freudian psychoanalytic-treat- 
ment procedures and advocating learning-theory procedures as alter- 
natives. There appears to be little doubt of cross-influences between 
Wolpe and Eysenck in the late 1950s. In 1960, Eysenck published a 
book of readings, Beltaviour Therapy and Neuroses, in which he pre- 
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sented a number of case histories in which variations of reciprocal- 
inhibition and respondent-conditioning procedures were used in 
clinical therapy. The respondent-conditioning orientation of behavior 
therapy has occasionally been referred to as the "Wolpe-Eysenck" 
school. 

In the late 1950s, Wolpe moved to the United States and began a 
program at Temple University in which he trained therapists in his 
particular version of behavior therapy. In 1963, Eysenck founded the 
journal Behaviour Research and Therapy, which publishes operant- 
oriented studies as well as studies with a Pavlovian flavor. As indicated 
in Table 28-1, behavior therapy within the respondent orientation grew 
quite rapidly in the 1960s and 1970s and developed applications to a 
variety of phobic and neurotic disorders. 


Mixtures and offshoots of the two orientations 


There seems to be little doubt that much of behavior modification 
and behavior therapy clearly falls within either the operant orienta- 
tion or the Pavlovian-Hullian-Wolpean orientation. Other devel- 
opments tend to be offshoots of one or the other of these traditions, 
and fall in a gray area somewhere in between them. One such devel- 
opment of significance is the work of Bandura and his colle 
modeling procedures (see Chapter 15). During the late 1950s 
1960s, people within the operant orientation were heavil 
sizing control by consequences (that is, reinforcement). Bandura com- 
plemented these developments by emphasizing control of behavior 
with stimulus management (namely, the presentation of models) 
without, however, also emphasizing the influence of controlling con- 
sequences. Bandura’s early work culminated in the publication in 
1969 of his book on behavior modification, a major source book (for 
the early 1970s) that integrated a great deal of the work in the 
major orientations. 

Another important development is that of precision teach 
mulated in the mid 1960s by Ogden Lindsley. Lindsley pion 
development of the Standard Behavior Chart, which he mai 
certain advantages over ordina 
standard charting, 


agues on 
and early 
y empha- 


two 


ing, for- 
eered the 
ntains has 
ty graph paper. (For discussion of 
see Kunzelmann, 1970). Precision teaching in- 
volves a relatively simple set of guidelines designed to enable teach- 
ers to precisely manage the behavior of Students. These guidelines 
encourage teachers to (1) pinpoint a behavior; (2) chart the behavior 
on a Standard Behavior Chart; (3) try Something to change the behav- 
ior; and (4) if the results are unsuccessful, try something else, Pre- 
cision teaching has promoted an emphasis on manipulating stimuli 
curricula, and variables other than consequences in influencing 
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behavior change. Precision-teaching workshops have spread through- 
out North America, and are having a significant influence in certain 
areas within education and special education (see, for example, Kun- 
zelmann, 1970; Teaching Exceptional Children, 1971). 

Additional developments in the 1960s that fall in the gray area 
of offshoots include Homme’s coverant control (see Chapter 25, note 
3), covert sensitization (see Chapter 14), contingency contracting (see 
Chapter 25), implosive therapy (see Chapter 15, note 8), and the Pre- 
mack Principle (see Chapter 25, note 3), and token economies (see 
Chapters 22, 23, and 24). 


BEHAVIOR THERAPY AND BEHAVIOR MODIFICATION 


COMPARED 


Although many writers use the terms behavior modification and be- 
havior therapy interchangeably, there are some differences in their 
historical derivations. It appears that Lindsley, Skinner, and Solomon 
(1953) were the first to use the term “behavior therapy." They did so 
in a report describing some research in which psychotic patients in 
a mental hospital were reinforced with candy or cigarettes for pulling 
a plunger. However, those within the operant orientation sub- 
sequently made little use of the term (at least, until the 1970s). The 
term "behavior therapy" became popular among those within the re- 
spondent-Hullian-Wolpian orientation after Eysenck (1959) used it to 
describe procedures published by Wolpe.” The first use of the term 
"behavior modification" appears to be in an article by R. I. Watson 
(1962). Since that time, many writers have distinguished between be- 
havior modification with its roots in operant conditioning and be- 
havior therapy with its roots in Pavlovian conditioning and Hullian 
theory. Others, however, have not made that distinction consistently. 
Ullmann and Krasner (1965), for example, frequently used "behavior 
modification" and "behavior therapy interchangeably. Also, critics 
tended to lump operant psychology with other learning, theories 
Eh skv, 1959), and behavior modification with Pavlovian condi- 
Pune Vora therapy, conditioning therapy, and learning-based 
therapies (see, for example, Breger and McGaugh, 1965). It has been 
argued that critiques and historical accounts of behavior modification- 
behavior therapy that do not clarify the particular orientation being 
ibis d chis Mash, 1974) are often misleading (Martin, 1974). 
mong ine that have tended to characterize the uses of the 
Lopes - resented in Table 28-2. In spite of these historical 
i ak iut wich there is a fair amount of agreement, the terms 
disti , 


appear to be blending more and more. 


TABLE 28-2. A ‘comparison of the uses of the terms "behavior therapy" 


and "behavior modification.” 
BEHAVIOR THERAPY 


1. The term is used most often by 
followers of the Pavlovian-Hul- 
lian-Wolpean orientation. 

2. The term tends to be used by be- 
havioral psychologists and psy- 
chiatrists who are concerned pri- 
marily with treatment in 
traditional clinical settings. 

3. The term tends to be used to re- 
fer to behavioral treatments con- 
ducted in the therapist's office 
by means of verbal interaction 
("talk therapy") between thera- 
pist and client. 

4. The term is associated with an 
experimental foundation that is 
based primarily on human stud- 
ies in clinical settings. 


5. The term tends to be favored in 
European countries. 


BEHAVIOR MODIFICATION 


The term is used most often by fol- 
lowers of the operant orientation. 


The term tends to be used by be- 
havior specialists in schools, 
homes, and other settings that are 
not primarily the domain of the clin- 
ical psychologist and psychiatrist. 
The term tends to be used for be- 
havioral treatments carried out in 
the natural environment as well as 
in special training settings. 


The term tends to be associated 
with an experimental foundation in 
basic operant research with animals 
and humans, in addition to experi- 
mental studies in applied settings. 


The term tends to be favored in the 
Americas. 


THE FUTURE OF BEHAVIOR MODIFICATION 


AND BEHAVIOR THERAPY 


As you can see in Table 28-1 
been applied to nearly all co 


problems. Issues of the Journal of A 


which good appl ti 
principles will be second n s o NS HT. beh 


happy, informed, skillful, 
prejudice, or pollution. 
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N 


17. 


18. 


. Cite five general statements that might answer the question, “What is 


behavior modification?” 


. How did Skinner's early work influence the initial development of be- 


havior modification? 


. Discuss Keller’s contribution to the development of behavior modi- 


fication (see text and note 4). 


. Many of the early reports in the operant tradition in the 1950s were 


straightforward experiments that demonstrated that consequences in- 
fluence human behavior. Briefly describe two such experiments. 


Briefly describe one of the first published reports (a very influential one) 
that concerned practical applications within the operant tradition. 


What is the Journal of the Experimental Analysis of Behavior? 


The publications of the early 1960s within the operant orientation seem 
to have been characterized by two features. What were they? 


Was the very influential book Case Studies in Behavior Modification strictly 
within the operant orientation? Why or why not? 


What did Ullmann and Krasner do? 
Briefly describe Watson and Rayner's experiment concerning a condi- 
tioned human reaction. 


. What behavior-therapy procedure do we credit to Joseph Wolpe? 


What role did Hans Eysenck play in the development of behavior ther- 
apy in the 1950s? 

What are the names of six behavior modification-behavior therapy 
journals? 

Studies within the early operant orientation emphasized control of be- 
havior by controlling its consequences. Briefly, how did Bandura's mod- 
eling studies complement this emphasis? 

Briefly, what is precision teaching, and who is its founder? 

Describe five differences in the usage of the terms "behavior therapy" 
and "behavior modification." (see Table 28-2). 

If someone suggested, "Behavior modification is okay for some limited 
types of problems," what would you say? 

Of the two major orientations in applied behavioral psychology, which 
do you think has influenced Martin and Pear more strongly? (Hint: 
They're the authors of this book.) Cite evidence to justify your answer. 


424 


For some discussion of the history of behavior modification from the 
early 1900s to the 1960s, see MacMillan (1973). More detailed dis- 
cussion of the Pavlovian influences on the development of behavior 
therapy can be found in Franks (1969) and Yates (1970). 


We believe that most of the major developments in the field of be- 
havior modification and behavior therapy from the 1950s to the present 
have taken place in North America. This is not to imply that there were 
no significant developments in other countries. See, for example, 
Franks (1969), for discussion of Pavlovian developments in the USSR; 
selected papers in Bijou and Ribez-Inesta (1972), for discussion of 
behavior modification in Mexico and some other Latin American 
countries; Yates (1970), for discussion of the development of behavior 
therapy in England; and papers in Thompson and Dockens (1975), for 
discussion of behavior modification in Australia; Brazil, Canada, 
England, Holland, Japan, and Sweden. 


For a complimentary discussion of th 
oriented behavior modification in the Uni 
Of special interest in Goodall's report is 
prominent behavior modifiers in American universities from 1930 
through 1970. Another source of behavior modification reports is Britt 
(1975), who also lists the top fifty publishing authors, according to his 
criteria. 


e development of Skinnerian- 
ted States, see Goodall (1972). 
his tracing of the movement of 


ion (see Keller, 1963, 1968; Ryan, 
eting of the Midwestern 


These “how-to-do-it” books cover areas suc 
dren (Azrin and Foxx, 1974), developing self- 


h as toilet-training chil- 
1972), and teaching social behavior to young 


Control (Watson and Tharp, 
Children (Sheppard, 1973). 


(Sulzer and Mayer, 1972; Johnston, 1975), psychiatr 
5, 1973), and rehabilitation medicine (Ince, 1976). 


Wood (1975) edited the proceedin 
Professional Issues and Behavi 


y (Task Force Report 


(Continued) 
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(continued) 

The general philosophical underpinnings of early behaviorism were 
given their initial formulation by Watson in two influential papers (1913, 
1916). At a time when American psychology was strongly influenced by 
instinct psychology and was soon to be influenced by Freudian psy- 
chology, Watson emphasized the value of an approach that concerned 
itself strictly with measurable behavior and its control by the environ- 
ment. Watson called this position "behaviorism" and has earned the 
title of "Father of Behaviorism" in the history of psychology. For a brief 
discussion of Watson's contributions to behavioristic psychology, see 
Marx and Hillix (1963). For more discussion of Watson's system, see 
Watson (1924). 


Yates (1970) credits Arnold Lazarus, an early colleague of Wolpe, 
with introducing the term in 1958. Moreover, Lazarus (1977, p. 551) states: 
“The terms behavior therapy and behavior therapist first appeared in 
print in the South African Medical Journal when l applied them to Wolpe's 
‘reciprocal inhibition’ framework (Lazarus, 1958)." 


CHAPTER 29 
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ETHICAL ISSUES 


INTRODUCTION 


ways that harmed 
ty. Because this is a real danger, it is fit- 


al chapter of this book to a more detailed 


; a rather subjective topic), 
ate those held by most 
The history of civilization is 
power. Throughout the ages, ps have used the rein- 
forcers and punishers at their di 
powerful groups (groups who had 
deliver, or who lacked the means 
lected target behaviors). The effe 


been to increase the reinforcements Occurri 
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the expense of those occurring to the less powerful. From time to 
time, as the proportion of total reinforcement allotted to them stead- 
ily dwindled, groups subjected to this abuse of power have success- 
fully revolted against their oppressors and have modified existing so- 
cial structures, or established new ones, in order to check or 
eliminate the possibility of future abuses. Constitutions, bills of 
rights, and related political documents of modern states can be 
viewed as formal specifications of contingencies designed to control 
the behavior of those who control the behavior of others. (In Western 
democracies, for example, we have moved from the era of the divine 
right of kings to one of “government by laws, not men." Moreover, 
with the introduction of periodic popular elections, the people who 
are controlled by those who make the laws can exert a certain mea- 
sure of reciprocal control: they can vote them out of office. In socialis- 
tic and communistic countries, on the other hand, the revolutionary 
process has concentrated on eradicating the abuses that stem from 
the disproportionate accumulation of personal wealth.) Nevertheless, 
the new social designs and practices that have emerged thus far have 
invariably fallen short of their objective; power continues to be 
abused throughout the world. 

Because of this cultural history, and because of people’s per- 
sonal experiences with others who have abused their power (that is, 
used it for their own benefit and to the disadvantage of those over 
whom they exerted control), people have learned to react negatively 
to all overt attempts to control behavior. This negative reaction is so 
strong that those who would control our behavior usually find that 
their efforts are more successful when they disguise their aims (as 
when advertisers, for example, use the “soft sell" rather than “hard 
sell," or when people who want to change our opinion on an issue 
contrive to make it appear that we arrived at the new opinion essen- 
tially by ourselves). It should not be surprising, therefore, that the 
emergence of behavior modification has evoked many negative reac- 
tions, ranging from suspicion to outright hostility. Behavior modi- 
fication is the technology based on the science that studies the factors 
that control behavior. This being the case, it is no secret that behav- 
ior modification is based on two propositions: (1) behavior can be 
controlled, and (2) it is desirable to do so in order to achieve certain 
objectives. Never before have such far-reaching techniques of behav- 
ior control been expressed so explicitly and advocated so strongly. 

Some behavior modifiers, noting that terms such as "control" 
often evoke violently negative reactions to behavior modification, 
would prefer to use terms that have less of an emotional impact. 
They suggest, for example, substituting "influence" for "control," be- 
cause they feel that the former term will help make behavior modi- 
fication more acceptable to the vast majority of people. However, the 
weaker term may have the opposite disadvantage: it may lead people 
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to underestimate the real power of behavior modification, and hence 
the dangers associated with its development, widespread use, and 
potential abuse. . 

Extreme wariness is a healthy reaction to any new, far-reaching 
advance in science or technology. Perhaps civilization would be in 
less danger if more precautions had been taken early in the devel- 
opment of, say, atomic energy. The solution to the present problems 
stemming from scientific and technological advances, however, does 
not lie in attempting to turn the clock back to 
cure, prescientific era. Science and technology 
They are merely highly Sophisticated means th 
oped for solving problems. The real problem is 
misuse these tools. This is, of course, a behavi 
seem, therefore, as Skinner argued in his bo 
Dignity (1971), that the science of behavior i 
solution of that problem. Like other 
nologies, however, behavior modificati 
fore appears that it will be necessa 
control itself. 


a seemingly more se- 
are not the problem. 
at people have devel- 
that people frequently 
oral problem. It would 
ok Beyond Freedom and 
s the logical key to the 
powerful sciences and tech- 
on can be misused. It there- 
ty to use behavior modification to 
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The doctrine of free will 
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pointless to attempt to discover laws of behavior, let alone to attempt 
to use those laws to control behavior. 

Besides tending to be comforting, the doctrine of free will has 
the added advantage that it can never be proved false. Even if behav- 
ior is completely determined, it is improbable that all of the laws de- 
termining it will be discovered or that they will ever be used to ob- 
tain complete control over behavior. Perfect prediction and control 
seem not to be achievable in physics, so it is unlikely that they will 
be achievable in the behavioral sciences. 

Whether or not behavior is completely determined by environ- 
mental and genetic factors (everyone agrees that it is at least partially 
determined by these factors) makes for interesting philosophical dis- 
cussions. From a practical point of view, however, it may make little 
difference one way or the other. The important point seems to be 
that the amount of potential control over behavior is steadily increas- 
ing, as a result of new discoveries in behavioral science and refine- 
ments in behavioral technology. Therefore, denying that complete 
control is possible (if used as an argument against behavior modi- 
fication) constitutes somewhat of a “head-in-the-sand” attitude to- 
wards the fact that behavior modification is already a powerful tech- 


nology and is expanding rapidly. 


Arguments against deliberately controlling behavior 


It is frequently argued that all attempts to control behavior are 
unethical.2_ A moment's reflection, however, shows that the goal of 
any social-help profession (such as education, psychology, and psy- 
chiatry) can be achieved only to the extent that the practitioners of 
that profession exert control over behavior. The goal of education, for 
example, is to change behavior so that students will respond differ- 
ently to their environment than they would had they not been edu- 
cated. To teach a person to read, for example, is to change her behav- 
ior in such a way that she responds to signs, newspapers, books, and 
so forth, in a manner that is different from the way she responded 
prior to being able to read. The goals of counseling, psychological 
treatment, and psychiatry likewise involve changing people’s behav- 
ior so that they can function more effectively then they did prior to 
receiving professional help. 

Many members of social-help professions do not like to think 
that they are controlling behavior. They prefer to see themselves as 
merely helping their clients achieve control over their own behavior. 
Establishing self-control, however, is also a form of behavior control. 
One simply teaches an individual to emit behavior that controls other 
behavior in some desired fashion. In order to do that, however, it is 
necessary to control the behavior involved in self-control. In other 
words, it is necessary to control the behavior that controls other be- 
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havior. The social-help practitioner may object that this is never- 
theless not control on his part because he withdraws his influence 
over the client’s behavior as soon as he is sure that the client is able 
to manage his behavior by himself. In actuality, as we have empha- 
sized repeatedly throughout this book, the Practitioner has simply 
shifted the control to the natural environment. One may speak of this 
as “withdrawing control,” but the control still continues, even 
though its form has changed. If the Practitioner has been successful 
in achieving the behavioral objectives, the desired behavior will be 
maintained, and in that sense the Practitioner’s control over the be- 
havior will persist. 

Some people will grant that social-hel 
engage in the control of behavior, but will never 
is wrong to deliberately plan to control beha 


vior. They regard plan- 
ning to be “cold” and "mechanical," 
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behavior modification consists of a wide variety of methods that sci- 
entific research has indicated are effective in changing behavior. This 
is a very large set of methods (as the contents of this book demon- 
strate), and the behavior modifier is therefore in a good position to 
select the method that is likely to do the most good and the least 
harm in the treatment of any given problem. 

Nevertheless, behavior modifiers often encounter objections to 
methods that they have judiciously selected. The objection is some- 
times purely emotional, as when, for example, the use of reinforce- 
ment is said to constitute “bribery.” The problem with this objection 
is that it is not based on a valid argument. It is merely name call- 
ing —attaching a negative label to something one wishes to discredit 
(see also Chapter 3, note 4). In order to be valid, the argument must 
show that the use of the procedure is likely to have an undesirable 
result. For example, one might argue that a child who has become ac- 
customed to receiving tokens for doing her schoolwork will thereby 
be hindered in learning to do her schoolwork without receiving tan- 
gible reinforcement. Of course, much evidence that we now have 
fails to support this argument. Even if the opposite were the case, 
however, the argument would not refute behavior modification. It 
would merely cause a particular procedure to be questioned. One 
would then have to decide whether the advantages of using the 
procedure outweigh its disadvantages relative to the advantages and 
disadvantages of some other procedure, By comparing different 
procedures in this way, one eventually selects the procedure that 
seems best suited to the problem at hand. 


ETHICAL SAFEGUARDS 


As we indicated at the beginning of this chapter, behavior modi- 
fication can be of great value but it also has the potential to be harm- 
ful. To promote the former and prevent the latter, we must build 
safeguards into the practice of behavior modification. 

At present, society is in the process of imposing contingencies 
on behavior modification. For example, recent court decisions in the 
United States have affirmed certain basic rights of mental patients, 
such as the right to their meals whether or not they have earned to- 
kens on ward programs." Behavior modifiers have therefore had to 
modify the types of back-up reinforcers that they use with these pa- 
tients, in order to ensure that these reinforcers are not items that al- 
ready rightfully belong to them. bes 

It is immediately obvious, therefore, that one obligation of be- 
havior modifiers is to make sure that their practices are within the 
law. Another obligation is, of course, to make sure that their practices 
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are consistent with sound ethical judgment. Where law and ethics 
seem to conflict, behavior modifiers should attempt to change the 
law. 

Behavior modifiers (preferably acting through their professional 
organizations) should seek to have their practices controlled in rea- 
sonable ways. Being students of the control of behavior, they are in a 
position to contribute valuable information to legislators and judges 
concerning the most appropriate types of control that should be ap- 
plied to the practice of behavior modification. Some reasonable rec- 
ommendations would include the following: All persons Practicing 
behavior modification should clearly demonstrate that they are pro- 
fessionally competent, that they use empirically validated methods, 
that they use the most effective methods with the least discomfort 
and harmful side effects, and that their goals and methods are always 
in the best interests of their clients. 

The establishment of impartial ethi 
formally ensure the accountabilit 
Programs is also an important safeguard (see Krapfl, 1975). Such 
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There are several basic ways to incorporate countercontrol into 


Ethical Issues a behavior modification program. These would include frequent op- 
portunities for clients to discuss and negotiate aspects of the program 
with the behavior modifiers, and allowing clients or their representa- 
tives to participate in programming decisions. Perhaps the best way 
for behavior modifiers to develop effective countercontrol through- 
out society is to spread their skills as widely as possible. It should be 
rather difficult to use behavior modification to the disadvantage of 
any group whose members are well versed in the principles and tac- 
tics of behavior modification. 


Study Questions 
(for examination purposes) 


N 


10. 


u 


13: 


Describe in behavioral terms how the history of civilization is a story of 
the continuous abuse of power. From your knowledge of history or cur- 
rent events, give an example of this abuse. 

From your knowledge of history or current events, give an example of 
what often happens when the reinforcements Occurring to one group in 
a society fall below a certain critical level relative to the reinforcements 
occurring to another group in that society. 

From a behavioral point of view, how might we account for constitu- 
tions, bills of rights, and related political documents of modern states? 
Explain why we tend to react negatively to all overt attempts to control 
our behavior. 

Why and how do people who would control our behavior disguise their 
aims? Give an example of this that is not in the text. 

State two propositions on which behavior modification is based. 

Discuss whether behavior modifiers should tone down their language so 
as not to use terms (such as “‘control’’) that frighten many people. 

Why is extreme wariness a healthy reaction to any new, far-reaching de- 
velopment in science or technology? Cite and discuss an example of this. 
Why is the doctrine of free will not a valid criticism of attempts to de- 
velop a technology of behavior? 

Explain why all social-help professions are involved in the control of be- 
havior, whether or not their practitioners realize it. Give an example. 


Discuss the relative merits of planning versus not planning for behavior 
change. 

Discuss three ethical arguments against the methods of behavior modi- 
fication, and the validity of these arguments. 

Why are behavior modifiers ethically obligated to help educate the gen- 
eral public with respect to behavior modification? 
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14. Briefly explain why some of the best safeguards against the abuse of be- 
havior modification have been mostly responsible for public alarm over 


behavior modification. 


15. Discuss countercontrol and ways in which it might be incorporated into 


behavior modification programs. 


16. Briefly explain why it should be rather difficult to use behavior modi- 
fication to the detriment of any group whose members are well versed in 


the principles and tactics of behavior modification. 


Study Exercise 


Make a fairly detailed list of ethical guidelines that beh 
should follow. 


For discussions of ethical issues in behavior Modification, see, for 
example Begelman (1975), Krasner (1976), Holland (1974), Skinner 
(1971), Braun (1975), and R. Martin (1975). 
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(continued) 
custodial care that leaves him unchanged and thus confined? But this 
question no longer belongs in the theoretical realm—it is being answered 
by the courts and legislatures. (p. 84) 


Martin sees the courts as being justified in this particular action. He 
goes on to state; 


The law will no longer tolerate manipulation of basic needs because, in 
the past, such programs have always sunk to the lowest allowable level 
and attempted to motivate everyone in that way. The therapist who can 
show a Human Rights Committee or a court a specific individual who has 
not responded to any less restrictive alternatives can probably win a 
chance to restrict meals for a few days. But if it does not produce some 
results within a very short time, such as forty-eight hours, then it will cer- 
tainly be discontinued. (p. 85) 


G. L. Martin (1975°; p. 85) has suggested that grass-roots behavior 
modification associations are one way to ensure that at least some of 
the general public will be knowledgeable about behavior modification 
and aware of the behavior modification projects being conducted in 
their communities. As an example of such an organization, he cites the 
Manitoba Behavior Modification Association, which "is concerned with 
providing information about behavior modification and its possible ap- 
plication to any interested person in the province. Membership is open 
to anyone who ascribes to the goals of promoting behavior modi- 
fication, abides by the ethical statement in the bylaws, and pays a nomi- 
nal membership fee. Members include parents, psychiatric nurses, psy- 
chologists, social workers, high school students, etc." 


Study Questions on Notes 


1. Critically discuss Skinner's view that we must go "beyond freedom 
and dignity" if civilization is to solve some of its most difficult prob- 


lems. 

2. Discuss the philosophical question raised by recent court decisions 
on behavior modification. 

8. Discuss how grass-roots behavior modification associations can help 
provide ethical controls on behavior modification. 
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tracing, 122 
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walking, 58-60 
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future of. 422 
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of depression, 373 
of discouragement, 186 
of disruptive behavior, 37 
of emotional disturbances, 169 
of "empty" apologies, 199 
of excessive crawling, 37 
of excessive T.V. watching, 86 
of fear, 208-209 
of gambling, 78 
+ of hyperactivity, 66 
of isolate play, 37 
- of learning disabilities, 12-13 
of lying, 199 
of misunderstandings, 108, 112-113 
of out-of-seat behavior, 190 
of overeating, 154, 157 
of persistence, 78-79 
of phobias, 203 
- of poor study habits, 373-374 
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of seizures, 249 
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- of withdrawal, 31 
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252-253, see also Chaining 
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backward, 147-148, 149-155 
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definition of stimulus-response chain, 
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examples, 146-151 
factors influencing effectiveness of, 
151-153 
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guidelines for application, 155 
misuses of term, 261 
pitfalls of, 153 
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natural, see Natural environment 
primary, 137 
social, 37-38 
types, 22-24, 35-36 
Precision Teaching, 420-421 
Premack Principle, 22-24, 340, 384 
Primary reinforcer, see Positive reinforcer 
Private behavior, see Behavior 
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environmental, 128-129, 133 
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physical, 128-129, 133, 233-234 
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Psychoanalytic theory and methods, 243, 
399, 402, 419 
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definition of principle, 178, 202 
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95-97, 100-101, 317 
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sponding, 97-98, 101, 178 
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fixed-duration, 87-88, 93-94 
fixed-interval, 79-80, 83 
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fixed-ratio, 75-78, 94 
guidelines for application, 90-91, 98-99 
in programming generalization, 168 
intermittent, 47, 75, 90 
variable-duration, 88-90, 93-94 
variable-interval, 84-85 
variable-interval-with-limited-hold, 
85-87 
Reinforcer menu, 25 
Reinforcer sampling, 60, 70, 142 
Reinforcer survey, 22-24 
Relaxation procedures, 215, 390-393, 397 
Reprimands, 37, 190 
Research, behavioral, 305-320 
Respondent behaviors, see Behavior 
Respondent conditioning 
contrasted with operant conditioning, 
204-209, 223 
definition of principle, 205 
examples, 205-209, 220, 222, 418 
guidelines for application, 220-224 
in history of behavior modification, 
416-420 
Respondent extinction, 223 
Response, 205, 277-278, see also Beh 
Response duration, 289 
Response generalization, 173 
Response rate, 283-287, 302-303 
Restitution, see Overcorrection 
Retardation 
as a label for behavior, 4-5, 6 
Reversal-replication design, 307-310, 
317-318 
Reward, compared with Positive 
reinforcement, 19 
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Rule-governed behavior, 409-410 
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Self-desensitization 
constructing the fear hierarchy, 387-390 
implementing the self-desensitization 
program, 393-394 
learning deep muscle relaxation, 
390-393 
Self-instructional methods, 403-404, see 
also Self-control; Cognitive 
behavior modification 
Self-reinforcement, as a questionable 
term, 384, see also Self-control 
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contrasted with chaining, 263-264 
contrasted with fading, 124 
defined, 60 
examples, 58-63, 70-72 
factors influencing effectiveness, 62-64 
guidelines, 67-68 
pitfalls, 64-67 
step size, 63, 71 
Sidman avoidance, 202-203 
Situational inducement, 235-240, 250-251 
Spontaneous recovery, 51 
Staff reinforcement (or incentive), 173, 
331-332, 354-355 
Statistical techniques, 313, 319 
Stimulus 
aversive, see Punisher 
conditioned, see Conditioned stimulus 
defined, 104 
discriminative, 105-108, 148-149, 151, 
152, 179, 236, 337, 372, 377, 409-410 
in respondent conditioning, 205 
unconditioned, see Unconditioned 
stimulus 
Stimulus class, 172-173 
Stimulus control 
assessment of, 290-292 
defined, 104, 116 
examples, 103-108, 109, 116-117 
factors determining effectiveness, 108, 
110-111 
in fading, 121-130 
guidelines for application, 113-114 
in partial elimination, 253 
pitfalls, 111-113 
in punishment, 179 
starting stimulus control, 128, 130 
target stimulus control, 128, 130 
Stimulus-discrimination training 
explained, 104-105 
traditional vs. errorless, 117-118 
Stress innoculations, 404 
Subjective units of discomfort (suds), 
388-389, 394, 395, 397 
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Superstitious behavior, 116 

Symptoms, 6-7, 12 

Systematic desensitization, 214-218, 223, 
419, see also Self-desensitization 


Test situation, see Natural environment 
Therapy, see Treatment program 
Thinking, 400-401, 408, see also Behavior 
(private) 
Thoughts, see Behavior (private) 
Thought-stopping, 405-406 
Time-out, see Punishment 
Timer-game, 93 
Time-sampling, 294-295, 303 
Token economy 
advantages of, 336-338 
defined, 137, 144-145, 335 
design considerations, 338-347 
engineering, 350-356 
instructions in, 243 
legal considerations, 340-341, 349 
problems and solutions, 358-362, 
364-365 
types of, 335-336, 348 
Token system, see also Token economy; 
Conditioned reinforcement (tokens) 
defined, 137 
Trapping, see Behavioral trap 
Treatment program 
accepting referrals, 324-326 
maintenance and evaluation, 332-333 
phases of, 270, 305 
preliminary considerations, 328-330 
selecting assessment procedures, 
326-328 
strategies of, 330-332 
Typel and Type Il errors, 280 
Two-factor theory, 223 
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reinforcer (primary) 
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52-53, 114, 362, see also 
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Reinforcement (thinning of) 
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Withdrawal design, 318 


